00000001:02000400:0.0F:1788863462.257916:0:2962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788863487.021420:0:3183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788863488.769452:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 639 MB/s 00000001:01000000:2.0F:1788863489.019079:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1043 MB/s 00000001:01000000:0.0:1788863489.268973:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2731 MB/s 00000020:02000000:2.0:1788863490.111958:0:3275:0:(class_obd.c:842:obdclass_init()) Lustre: Build Version: 2.17.58_39_g86006df 00000400:02000000:2.0:1788863491.055963:0:3290:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.151@tcp [8/256/0/180] 00008000:02000000:3.0F:1788863495.888791:0:3440:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788863551.248203:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788863563.578505:0:5821:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788863563.578512:0:5821:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788863563.578658:0:5821:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000eb39b356 00000080:02000400:3.0:1788863563.578671:0:5821:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788863563.590560:0:5821:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788863563.590655:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788863563.591248:0:5821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000354e182e) 00000020:00000080:2.0:1788863563.591280:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0F:1788863563.627470:0:5821:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788863563.628137:0:5821:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788863563.676575:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788863563.676844:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788863563.677029:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788863563.677097:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788863563.677125:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788863563.678115:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788863563.678125:0:5821:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788863563.678138:0:5821:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbba7f5 00000020:01000004:3.0:1788863563.678157:0:5821:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788863563.678234:0:5821:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788863563.678239:0:5821:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000eb39b356 from MGS 00000020:01000004:3.0:1788863563.678244:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788863563.678265:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d2e09648) 00000020:00000080:3.0:1788863563.678278:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788863563.678449:0:5821:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eb39b356 from MGS, refs=2 00080000:01000000:3.0:1788863563.678455:0:5821:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788863563.678469:0:5821:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbba803 00000100:00100000:3.0:1788863563.678661:0:5821:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788863563.679091:0:5821:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788863563.679098:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788863563.680298:0:5821:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788863563.680374:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788863563.681451:0:5821:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863563.681635:0:5821:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788863563.681640:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788863563.683671:0:5821:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788863563.683843:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788863563.685290:0:5821:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788863563.685304:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788863563.689048:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863563.689056:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863563.689058:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863563.691303:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863563.691321:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863563.691324:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863563.693060:0:5821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788863563.700189:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788863563.942709:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2195 MB/s 00000001:01000000:1.0:1788863564.194575:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2480 MB/s 00000001:01000000:2.0:1788863564.447303:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 699 MB/s 00000001:01000000:0.0:1788863564.697094:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 563 MB/s 00080000:10000000:0.0:1788863564.709799:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1788863564.745478:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788863564.745511:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788863564.745515:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788863564.746400:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788863564.746528:0:5821:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788863564.746567:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788863564.746780:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788863564.746809:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788863564.747234:0:5821:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863564.747573:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788863564.747579:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788863564.752050:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788863564.752200:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788863564.755797:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788863564.755819:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788863564.756755:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788863564.756782:0:5821:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.151@tcp' 00000020:01000004:0.0:1788863564.756784:0:5821:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788863564.756848:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.151@tcp (typ=mgc) 00000020:00000080:0.0:1788863564.756902:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.151@tcp (00000000f339369b) 00000020:00000080:0.0:1788863564.756922:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788863564.757007:0:5821:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002a06ea38@MGC192.168.204.151@tcp: add connection 192.168.204.151@tcp at head 00000100:00080000:1.0:1788863564.757397:0:5836:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1788863564.758007:0:5821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.151@tcp-0 is initialized 00000040:01000000:1.0:1788863564.758015:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 1 is initialized 00010000:00010000:0.0:1788863564.758542:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788863564.766536:0:5838:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788863564.766730:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.151@tcp (uuid eff03fbe-e653-4192-b926-0416f2048378) 00000020:00000080:0.0:1788863564.766761:0:5821:0:(genops.c:1384:class_connect()) connect: client eff03fbe-e653-4192-b926-0416f2048378, cookie 0x744cd7666bbba811 00000100:00080000:0.0:1788863564.766779:0:5821:0:(import.c:545:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788863564.766794:0:5821:0:(import.c:666:import_select_connection()) MGC192.168.204.151@tcp: import 000000002a06ea38 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788863564.766884:0:5821:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000917f3825 x1875759323938944/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863564.766911:0:5821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import eff03fbe-e653-4192-b926-0416f2048378->MGS 00000020:01000004:0.0:1788863564.766933:0:5821:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788863564.766937:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788863564.766950:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ec53d0a3) 00000020:00000080:0.0:1788863564.766966:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788863564.767779:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000917f3825 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eff03fbe-e653-4192-b926-0416f2048378:3305:1875759323938944:0@lo:250: 00000100:00100000:1.0:1788863564.767907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863564.767982:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323938944 00000100:00100000:0.0:1788863564.767991:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323938944 00000100:00100000:0.0:1788863564.768035:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863564.768041:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a4800d66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1875759323938944:12345-0@lo:250: 00010000:00080000:0.0:1788863564.770339:0:5832:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from eff03fbe-e653-4192-b926-0416f2048378@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1788863564.770455:0:5832:0:(genops.c:1384:class_connect()) connect: client eff03fbe-e653-4192-b926-0416f2048378, cookie 0x744cd7666bbba81f 00000100:00080000:0.0:1788863564.770676:0:5832:0:(import.c:65:import_set_state_nolock()) 000000009dff6010 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863564.770887:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a4800d66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+5:3305:x1875759323938944:12345-0@lo:250: Request processed in 2842us (2979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863564.770913:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863564.771007:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788863564.771030:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.151@tcp: connect to target with instance 0 00000100:00080000:0.0:1788863564.771039:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788863564.771043:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788863564.771046:0:3305:0:(import.c:65:import_set_state_nolock()) 000000002a06ea38 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788863564.771049:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788863564.771068:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788863564.771074:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000917f3825 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eff03fbe-e653-4192-b926-0416f2048378:3305:1875759323938944:0@lo:250: 00000100:00100000:1.0:1788863564.794090:0:5821:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863564.794844:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788863564.794872:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788863564.796726:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788863564.796737:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788863564.802270:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788863564.802284:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788863564.803469:0:5821:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863564.803675:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788863564.803681:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788863564.805008:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788863564.805118:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788863564.857768:0:5821:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863564.858403:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788863564.858410:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788863564.860302:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788863564.860315:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788863564.861091:0:5821:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863564.861317:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788863564.861324:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788863564.862283:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788863564.862292:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788863564.864763:0:5821:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863564.865280:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788863564.865287:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788863564.866346:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788863564.866356:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788863564.867275:0:5821:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863564.867478:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788863564.867483:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788863564.868457:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788863564.868473:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788863564.943494:0:5821:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788863564.945515:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788863564.945527:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788863564.949465:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788863564.949484:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788863564.966261:0:5821:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788863564.966279:0:5821:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788863564.971298:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788863564.971349:0:5821:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788863564.971359:0:5821:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788863564.971587:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788863564.973572:0:5821:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788863564.973582:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788863564.973584:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788863564.973586:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863564.973587:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863564.973588:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863564.973589:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863564.973590:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788863564.973592:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788863564.973593:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788863564.973595:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788863564.973596:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863564.973598:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788863564.973602:0:5821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788863564.973615:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788863564.973617:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788863564.973618:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863564.973618:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863564.973619:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863564.973620:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863564.973621:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788863564.973622:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788863564.973623:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788863564.973624:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788863564.973625:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863564.973741:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788863564.973881:0:5821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788863564.973899:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000917f3825 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939072:0@lo:253: 00000100:00100000:0.0:1788863564.974028:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863564.974285:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025345c18 going to sleep for 11 seconds 00000100:00100000:1.0:1788863564.974438:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323939072 00000100:00100000:1.0:1788863564.974446:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323939072 00000100:00100000:1.0:1788863564.974528:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863564.974537:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009022e323 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+5:5821:x1875759323939072:12345-0@lo:253: 20000000:01000000:1.0:1788863564.974594:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788863564.974597:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788863564.975704:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788863564.975817:0:5835:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788863564.977100:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788863564.982309:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788863564.987811:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788863564.987823:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788863564.987832:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788863564.987837:0:5835:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788863564.987930:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788863564.989034:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863564.991409:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788863564.991460:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788863564.991533:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788863564.992541:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788863564.992616:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788863564.992791:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788863564.992802:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788863564.992885:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788863564.992893:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788863564.992925:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788863564.992932:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788863564.992959:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788863564.993046:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788863564.993092:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788863564.993097:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788863564.993110:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863564.993349:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788863564.993360:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788863564.993395:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788863564.993429:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788863564.993489:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788863564.993504:0:5835:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788863564.993586:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788863564.993595:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788863564.993656:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788863564.993695:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788863564.993731:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788863564.993743:0:5835:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788863564.993827:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788863564.993837:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788863564.993900:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788863564.994414:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788863564.994607:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788863564.994669:0:5835:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788863564.994772:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788863564.995506:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788863564.996159:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788863564.996195:0:5835:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.151@tcp for mdt 20000000:01000000:1.0:1788863564.996198:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:1.0:1788863564.996234:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788863564.996243:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788863564.996270:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788863564.996277:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:1.0:1788863564.996333:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788863564.996344:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788863564.996394:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788863564.996429:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788863564.996488:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788863564.996491:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788863564.996494:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788863564.996505:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788863564.996508:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788863564.996544:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788863564.996548:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788863564.999157:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788863564.999587:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788863564.999711:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788863564.999802:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1788863564.999823:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788863564.999826:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788863565.003714:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788863565.007035:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788863565.007326:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788863565.007361:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788863565.007378:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788863565.007381:0:5835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788863565.007386:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788863565.007388:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788863565.007393:0:5835:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788863565.007400:0:5835:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788863565.008461:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788863565.008697:0:5835:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788863565.024448:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788863565.024512:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788863565.024635:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788863565.024661:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788863565.024684:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a16898da/0x744cd7666bbba826 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.024709:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a16898da/0x744cd7666bbba826 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.024721:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a16898da/0x744cd7666bbba826 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.024728:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a16898da/0x744cd7666bbba826 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.024734:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a16898da/0x744cd7666bbba826 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.024742:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a16898da/0x744cd7666bbba826 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.024749:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a16898da already unused, calling callback (000000004a72eb6a) 00010000:00010000:1.0:1788863565.024754:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a16898da/0x744cd7666bbba826 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.024761:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a16898da/0x744cd7666bbba826 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.024787:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a16898da/0x744cd7666bbba826 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.024795:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a16898da/0x744cd7666bbba826 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.024801:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a16898da/0x744cd7666bbba826 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788863565.024821:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788863565.337730:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009022e323 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+5:5821:x1875759323939072:12345-0@lo:253: Request processed in 363181us (363689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.337755:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863565.337909:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000917f3825 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939072:0@lo:253: 10000000:01000000:1.0:1788863565.337930:0:5821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788863565.337933:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788863565.337936:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788863565.337938:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863565.337939:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788863565.337940:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863565.337942:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863565.337943:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788863565.337945:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788863565.337947:0:5821:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788863565.337948:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863565.337949:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788863565.337977:0:5821:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000eb39b356 from lustre-MDT0000 10000000:01000000:1.0:1788863565.338023:0:5821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788863565.338027:0:5821:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788863565.338031:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e8bc84bb380 10000000:01000000:1.0:1788863565.338037:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863565.338046:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8bc84bb380 from 1 10000000:01000000:1.0:1788863565.338048:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788863565.338115:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000a16898da/0x744cd7666bbba82d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.338135:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000a16898da/0x744cd7666bbba82d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.338145:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000a16898da/0x744cd7666bbba82d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863565.338162:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076aea43d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939200:0@lo:101: 00000100:00100000:1.0:1788863565.338201:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863565.338259:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cebe2339 going to sleep for 11 seconds 00000100:00100000:2.0:1788863565.338335:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323939200 00000100:00100000:2.0:1788863565.338343:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323939200 00000100:00100000:2.0:1788863565.338459:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863565.338468:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000337f920f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+5:5821:x1875759323939200:12345-0@lo:101: 00010000:00010000:2.0:1788863565.338483:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863565.338501:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c57176bc/0x744cd7666bbba834 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba82d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.338525:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c57176bc/0x744cd7666bbba834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba82d expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.338535:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c57176bc/0x744cd7666bbba834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba82d expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.338545:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c57176bc, rc 0) 00000100:00100000:2.0:1788863565.338590:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000337f920f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+6:5821:x1875759323939200:12345-0@lo:101: Request processed in 124us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.338597:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863565.338841:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076aea43d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939200:0@lo:101: 00010000:00010000:1.0:1788863565.338895:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000a16898da/0x744cd7666bbba82d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba834 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.338905:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000a16898da/0x744cd7666bbba82d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba834 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863565.338968:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076aea43d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939328:0@lo:501: 00000100:00100000:1.0:1788863565.338997:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863565.339027:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cebe2339 going to sleep for 11 seconds 00000100:00100000:2.0:1788863565.339081:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323939328 00000100:00100000:2.0:1788863565.339086:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323939328 00000100:00100000:2.0:1788863565.339119:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863565.339125:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b65881f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+6:5821:x1875759323939328:12345-0@lo:501: 00000100:00100000:2.0:1788863565.339580:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b65881f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+6:5821:x1875759323939328:12345-0@lo:501: Request processed in 454us (581us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863565.339588:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863565.339651:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076aea43d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939328:0@lo:501: 10000000:01000000:1.0:1788863565.339682:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788863565.339740:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000a16898da/0x744cd7666bbba82d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba834 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.339750:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000a16898da/0x744cd7666bbba82d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba834 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863565.339771:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8bd56cb800 10000000:01000000:1.0:1788863565.339776:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788863565.339780:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e8bd56cb800 10000000:01000000:1.0:1788863565.339782:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788863565.339785:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e8bd56cb800 from 1 10000000:01000000:1.0:1788863565.339788:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788863565.339818:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000001b274a1/0x744cd7666bbba83b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.339826:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000001b274a1/0x744cd7666bbba83b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.339835:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000001b274a1/0x744cd7666bbba83b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863565.339882:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076aea43d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939456:0@lo:101: 00000100:00100000:1.0:1788863565.339916:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863565.339942:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cebe2339 going to sleep for 11 seconds 00000100:00100000:2.0:1788863565.340002:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323939456 00000100:00100000:2.0:1788863565.340017:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323939456 00000100:00100000:2.0:1788863565.340051:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788863565.340058:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000044fed93e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+6:5821:x1875759323939456:12345-0@lo:101: 00010000:00010000:2.0:1788863565.340068:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863565.340082:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fbed91e9/0x744cd7666bbba842 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba83b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.340098:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fbed91e9/0x744cd7666bbba842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba83b expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.340107:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fbed91e9/0x744cd7666bbba842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba83b expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.340114:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fbed91e9, rc 0) 00000100:00100000:2.0:1788863565.340150:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000044fed93e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+7:5821:x1875759323939456:12345-0@lo:101: Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.340157:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863565.340229:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076aea43d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939456:0@lo:101: 00010000:00010000:1.0:1788863565.340240:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000001b274a1/0x744cd7666bbba83b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.340249:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000001b274a1/0x744cd7666bbba83b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863565.340261:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788863565.340473:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000001b274a1/0x744cd7666bbba83b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.340496:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000001b274a1/0x744cd7666bbba83b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863565.340503:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788863565.340506:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863565.340511:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e8bd56cb800 10000000:01000000:1.0:1788863565.340513:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788863565.340517:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788863565.340519:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788863565.340537:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000067160ee2/0x744cd7666bbba849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.340543:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000067160ee2/0x744cd7666bbba849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.340550:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000067160ee2/0x744cd7666bbba849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863565.340563:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076aea43d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939584:0@lo:101: 00000100:00100000:1.0:1788863565.340589:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863565.340611:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cebe2339 going to sleep for 11 seconds 00000100:00100000:2.0:1788863565.340663:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323939584 00000100:00100000:2.0:1788863565.340676:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323939584 00000100:00100000:2.0:1788863565.340705:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788863565.340711:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003d7e2052 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+7:5821:x1875759323939584:12345-0@lo:101: 00010000:00010000:2.0:1788863565.340719:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863565.340726:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007364d941/0x744cd7666bbba850 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba849 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.340738:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007364d941/0x744cd7666bbba850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba849 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.340745:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007364d941/0x744cd7666bbba850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba849 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.340753:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007364d941, rc 0) 00000100:00100000:2.0:1788863565.340790:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003d7e2052 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+8:5821:x1875759323939584:12345-0@lo:101: Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.340796:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863565.340904:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076aea43d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939584:0@lo:101: 00010000:00010000:3.0:1788863565.340915:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000067160ee2/0x744cd7666bbba849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba850 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.340922:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000067160ee2/0x744cd7666bbba849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba850 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863565.340979:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000350f4459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939712:0@lo:501: 00000100:00100000:3.0:1788863565.341015:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863565.341032:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f554e0c going to sleep for 11 seconds 00000100:00100000:1.0:1788863565.341086:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323939712 00000100:00100000:1.0:1788863565.341090:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323939712 00000100:00100000:1.0:1788863565.341120:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863565.341125:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f7535ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+8:5821:x1875759323939712:12345-0@lo:501: 00000100:00100000:1.0:1788863565.341389:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f7535ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+9:5821:x1875759323939712:12345-0@lo:501: Request processed in 263us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863565.341396:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788863565.341487:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000350f4459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939712:0@lo:501: 00000100:00100000:3.0:1788863565.341516:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000350f4459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939840:0@lo:503: 00000100:00100000:3.0:1788863565.341555:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863565.341577:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f554e0c going to sleep for 11 seconds 00000100:00100000:2.0:1788863565.341641:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323939840 00000100:00100000:2.0:1788863565.341646:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323939840 00000100:00100000:2.0:1788863565.341674:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863565.341681:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000dda7adf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+9:5821:x1875759323939840:12345-0@lo:503: 00000100:00100000:2.0:1788863565.341894:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000dda7adf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+9:5821:x1875759323939840:12345-0@lo:503: Request processed in 214us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.341901:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788863565.341981:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000350f4459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323939840:0@lo:503: 00000100:00100000:3.0:1788863565.342591:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000350f4459 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:5863:1875759323939968:0@lo:502: 00000100:00100000:3.0:1788863565.342636:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863565.342665:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 000000008eea450b going to sleep for 11 seconds 00000100:00100000:2.0:1788863565.342716:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323939968 00000100:00100000:2.0:1788863565.342721:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323939968 00000100:00100000:2.0:1788863565.342754:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788863565.342760:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d3d83e70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+9:5863:x1875759323939968:12345-0@lo:502: 00000100:00100000:2.0:1788863565.342981:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d3d83e70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+9:5863:x1875759323939968:12345-0@lo:502: Request processed in 220us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.342994:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863565.343131:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000350f4459 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:5863:1875759323939968:0@lo:502: 00000020:01000000:1.0:1788863565.343157:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863565.343168:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863565.343171:0:5863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788863565.343178:0:5863:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788863565.343181:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788863565.343202:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001e05e000) 00000020:00000080:1.0:1788863565.343225:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788863565.343231:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788863565.343318:0:5863:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788863565.343326:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbba85e 00000020:00000080:1.0:1788863565.343586:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788863565.343591:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863565.343595:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863565.343596:0:5863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788863565.343599:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863565.343602:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863565.343604:0:5863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788863565.343607:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788863565.343613:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000005babcb0) 00000020:00000080:1.0:1788863565.343623:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788863565.343626:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788863565.343628:0:5863:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788863565.343631:0:5863:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788863565.343637:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788863565.343683:0:5863:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eb39b356 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788863565.343698:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002fb965b8) 00000020:00000080:1.0:1788863565.343705:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788863565.343770:0:5863:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788863565.343776:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x744cd7666bbba873 00000020:00000080:1.0:1788863565.343912:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788863565.343918:0:5863:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788863565.343928:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x744cd7666bbba87a 00080000:01000000:1.0:1788863565.343935:0:5863:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788863565.343938:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbba881 00080000:10000000:1.0:1788863565.344394:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788863565.344637:0:5863:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788863565.348712:0:5863:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788863565.442640:0:5863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788863565.443510:0:5863:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788863565.447620:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788863565.449802:0:5863:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788863565.565642:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d7ea95df) 00000020:00000080:3.0:1788863565.565667:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788863565.566465:0:5863:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788863565.566475:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbba88f 00000020:00000080:2.0:1788863565.576147:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788863565.579882:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788863565.617543:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788863565.653959:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788863565.704519:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788863565.765989:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:0.0:1788863565.784988:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788863565.822586:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788863565.868570:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x744cd7666bbba896 00000020:00000080:3.0:1788863565.869196:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788863565.869208:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863565.869215:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863565.869217:0:5863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788863565.869221:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863565.869225:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863565.869226:0:5863:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788863565.869229:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788863565.869231:0:5863:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788863565.869233:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863565.869236:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863565.869236:0:5863:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788863565.869239:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863565.869243:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863565.869244:0:5863:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788863565.869248:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788863565.869285:0:5863:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788863565.869362:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d2aec0da pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:5863:1875759323940096:0@lo:502: 00000100:00100000:3.0:1788863565.869597:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863565.869677:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039825242 going to sleep for 11 seconds 00000100:00100000:2.0:1788863565.869940:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323940096 00000100:00100000:2.0:1788863565.869950:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323940096 00000100:00100000:2.0:1788863565.870011:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863565.870020:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009a596f10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+9:5863:x1875759323940096:12345-0@lo:502: 00000100:00100000:2.0:1788863565.870580:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009a596f10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+9:5863:x1875759323940096:12345-0@lo:502: Request processed in 559us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.870591:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788863565.870943:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d2aec0da pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:5863:1875759323940096:0@lo:502: 00000020:01000000:0.0:1788863565.870979:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863565.870988:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863565.870990:0:5863:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788863565.871004:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788863565.871208:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788863565.871225:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788863565.871247:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000067160ee2/0x744cd7666bbba849 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba850 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.871259:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000067160ee2/0x744cd7666bbba849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba850 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863565.871268:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e8bd56cb800 from 1 10000000:01000000:2.0:1788863565.871271:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788863565.871315:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.871323:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.871336:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863565.871516:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003debe130 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940224:0@lo:101: 00000100:00100000:2.0:1788863565.871563:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863565.871635:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000190090fe going to sleep for 11 seconds 00000100:00100000:3.0:1788863565.871987:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323940224 00000100:00100000:3.0:1788863565.872003:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323940224 00000100:00100000:3.0:1788863565.872079:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863565.872087:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cd097ebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+9:5821:x1875759323940224:12345-0@lo:101: 00010000:00010000:3.0:1788863565.872108:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863565.872122:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006e453aa2/0x744cd7666bbba8a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba89d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.872145:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e453aa2/0x744cd7666bbba8a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba89d expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.872153:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006e453aa2/0x744cd7666bbba8a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba89d expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.872161:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006e453aa2, rc 0) 00000100:00100000:3.0:1788863565.872207:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cd097ebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+10:5821:x1875759323940224:12345-0@lo:101: Request processed in 121us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863565.872214:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788863565.872274:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003debe130 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940224:0@lo:101: 00010000:00010000:0.0:1788863565.872287:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863565.872294:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba8a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863565.873161:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c33dd966 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940352:0@lo:256: 00000100:00100000:0.0:1788863565.873204:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863565.873537:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323940352 00000100:00100000:2.0:1788863565.873545:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323940352 00000100:00100000:2.0:1788863565.873575:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863565.873581:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000072ed9df4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+10:5821:x1875759323940352:12345-0@lo:256: 20000000:01000000:2.0:1788863565.873598:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788863565.873604:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788863565.873667:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000072ed9df4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+10:5821:x1875759323940352:12345-0@lo:256: Request processed in 86us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.873674:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788863565.874102:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc48298f going to sleep for 11 seconds 00000100:00100000:1.0:1788863565.874127:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c33dd966 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940352:0@lo:256: 10000000:01000000:1.0:1788863565.875776:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788863565.875926:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.875942:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863565.875952:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bd56cb800 from 1 10000000:01000000:1.0:1788863565.875954:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788863565.876008:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.876015:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.876025:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863565.876048:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096dcbc8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940480:0@lo:101: 00000100:00100000:1.0:1788863565.876117:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863565.876223:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c63000f3 going to sleep for 11 seconds 00000100:00100000:3.0:1788863565.876584:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323940480 00000100:00100000:3.0:1788863565.876593:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323940480 00000100:00100000:3.0:1788863565.876683:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788863565.876692:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ef24e781 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+10:5821:x1875759323940480:12345-0@lo:101: 00010000:00010000:3.0:1788863565.876771:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863565.876787:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000996aa20c/0x744cd7666bbba8b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba8ab expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.876810:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000996aa20c/0x744cd7666bbba8b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba8ab expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.876829:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000996aa20c/0x744cd7666bbba8b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba8ab expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.876837:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000996aa20c, rc 0) 00000100:00100000:3.0:1788863565.876925:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ef24e781 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+11:5821:x1875759323940480:12345-0@lo:101: Request processed in 234us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863565.876932:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863565.877018:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096dcbc8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940480:0@lo:101: 00010000:00010000:1.0:1788863565.877038:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8b2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.877046:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba8b2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863565.877100:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096dcbc8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940608:0@lo:501: 00000100:00100000:1.0:1788863565.877125:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863565.877426:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c63000f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788863565.877553:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323940608 00000100:00100000:2.0:1788863565.877558:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323940608 00000100:00100000:2.0:1788863565.877582:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788863565.877589:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006409b779 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+11:5821:x1875759323940608:12345-0@lo:501: 00000100:00100000:2.0:1788863565.878521:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006409b779 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+11:5821:x1875759323940608:12345-0@lo:501: Request processed in 931us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.878532:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788863565.878668:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096dcbc8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940608:0@lo:501: 00000100:00100000:1.0:1788863565.878736:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096dcbc8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940736:0@lo:503: 00000100:00100000:1.0:1788863565.878785:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863565.878810:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c63000f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788863565.879045:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323940736 00000100:00100000:2.0:1788863565.879053:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323940736 00000100:00100000:2.0:1788863565.879088:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863565.879094:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000db1db914 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+11:5821:x1875759323940736:12345-0@lo:503: 00000040:00080000:2.0:1788863565.879152:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788863565.879201:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000db1db914 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+11:5821:x1875759323940736:12345-0@lo:503: Request processed in 107us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.879208:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788863565.879295:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096dcbc8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940736:0@lo:503: 00000040:00080000:2.0:1788863565.880919:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788863565.881327:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788863565.881528:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788863565.881547:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8b2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.881560:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8b2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863565.881606:0:5821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788863565.881609:0:5821:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8bd56cb800 10000000:01000000:1.0:1788863565.881612:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8bd56cb800 10000000:01000000:1.0:1788863565.881615:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863565.881621:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e8bd56cb800 from 1 10000000:01000000:1.0:1788863565.881624:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788863565.881672:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000082f9b856/0x744cd7666bbba8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.881679:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000082f9b856/0x744cd7666bbba8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.881690:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000082f9b856/0x744cd7666bbba8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863565.881902:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096dcbc8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940864:0@lo:101: 00000100:00100000:1.0:1788863565.881975:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863565.882010:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e6e00aac going to sleep for 11 seconds 00000100:00100000:2.0:1788863565.882120:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323940864 00000100:00100000:2.0:1788863565.882129:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323940864 00000100:00100000:2.0:1788863565.882165:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788863565.882173:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000070d7fa34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+11:5821:x1875759323940864:12345-0@lo:101: 00010000:00010000:2.0:1788863565.882185:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863565.882198:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000061470f0c/0x744cd7666bbba8c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba8b9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.882224:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061470f0c/0x744cd7666bbba8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba8b9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.882235:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000061470f0c/0x744cd7666bbba8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba8b9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.882243:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000061470f0c, rc 0) 00000100:00100000:2.0:1788863565.882288:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000070d7fa34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:5821:x1875759323940864:12345-0@lo:101: Request processed in 116us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.882295:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788863565.882625:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096dcbc8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940864:0@lo:101: 00010000:00010000:1.0:1788863565.882639:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000082f9b856/0x744cd7666bbba8b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8c0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863565.882647:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000082f9b856/0x744cd7666bbba8b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba8c0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863565.882771:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096dcbc8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940992:0@lo:501: 00000100:00100000:1.0:1788863565.882803:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863565.882946:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323940992 00000100:00100000:2.0:1788863565.882952:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323940992 00000100:00100000:2.0:1788863565.883081:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863565.883089:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004bcc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:5821:x1875759323940992:12345-0@lo:501: 00000100:00100000:2.0:1788863565.883796:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004bcc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:5821:x1875759323940992:12345-0@lo:501: Request processed in 706us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.883811:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788863565.884147:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e6e00aac going to sleep for 11 seconds 00000100:00100000:1.0:1788863565.884166:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096dcbc8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323940992:0@lo:501: 00000100:00100000:1.0:1788863565.884206:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096dcbc8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323941120:0@lo:503: 00000100:00100000:1.0:1788863565.884249:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863565.884310:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e6e00aac going to sleep for 11 seconds 00000100:00100000:3.0:1788863565.884434:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323941120 00000100:00100000:3.0:1788863565.884441:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323941120 00000100:00100000:3.0:1788863565.884588:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788863565.884598:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000026bb254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:5821:x1875759323941120:12345-0@lo:503: 00000100:00100000:3.0:1788863565.885103:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000026bb254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:5821:x1875759323941120:12345-0@lo:503: Request processed in 506us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863565.885112:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788863565.885290:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096dcbc8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323941120:0@lo:503: 00000100:00100000:2.0:1788863565.886156:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000339e902f pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:5868:1875759323941248:0@lo:502: 00000100:00100000:2.0:1788863565.886211:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863565.886361:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054fe1397 going to sleep for 11 seconds 00000100:00100000:1.0:1788863565.886542:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323941248 00000100:00100000:1.0:1788863565.886550:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323941248 00000100:00100000:1.0:1788863565.886588:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788863565.886595:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000067e9791b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:5868:x1875759323941248:12345-0@lo:502: 00000100:00100000:2.0:1788863565.887163:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000067e9791b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:5868:x1875759323941248:12345-0@lo:502: Request processed in 567us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863565.887171:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788863565.887221:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000339e902f pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:5868:1875759323941248:0@lo:502: 00000020:01000004:2.0:1788863565.887282:0:5868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788863565.887296:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d5214a34) 00000020:00000080:2.0:1788863565.887313:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788863565.887411:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eb39b356 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788863565.887415:0:5868:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000eb39b356 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788863565.887418:0:5868:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000eb39b356 4 00010000:00080000:2.0:1788863565.887449:0:5868:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003c546e02@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1788863565.890189:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788863565.890396:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788863565.890433:0:5868:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788863565.890446:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x744cd7666bbba8ce 00000100:00080000:2.0:1788863565.890520:0:5868:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788863565.890532:0:5868:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003c546e02 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788863565.890575:0:5868:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000339e902f x1875759323941376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788863565.890600:0:5868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788863565.890878:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000339e902f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875759323941376:0@lo:38: 00000100:00100000:0.0:1788863565.890945:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863565.891045:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323941376 00000100:00100000:2.0:1788863565.891064:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323941376 00000100:00100000:2.0:1788863565.891101:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863565.891108:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000941dfc02 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875759323941376:12345-0@lo:38: 00000100:00100000:2.0:1788863565.891163:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000941dfc02 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875759323941376:12345-0@lo:38: Request processed in 55us (218us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788863565.891170:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863565.894162:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006cb5802 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:5868:1875759323941504:0@lo:502: 00000100:00100000:2.0:1788863565.894279:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863565.894421:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788863565.894430:0:3305:0:(import.c:65:import_set_state_nolock()) 000000003c546e02 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863565.894434:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788863565.894437:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000339e902f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875759323941376:0@lo:38: 00000100:00100000:1.0:1788863565.896991:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323941504 00000100:00100000:1.0:1788863565.897021:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323941504 00000100:00100000:1.0:1788863565.897106:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788863565.897115:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d02f533a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:5868:x1875759323941504:12345-0@lo:502: 00000100:00100000:1.0:1788863565.897901:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d02f533a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:5868:x1875759323941504:12345-0@lo:502: Request processed in 339us (3174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863565.897915:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788863565.906563:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 00000000015e5dc8 going to sleep for 11 seconds 00000100:00100000:2.0:1788863565.906612:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006cb5802 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:5868:1875759323941504:0@lo:502: 00000040:00080000:2.0:1788863565.906667:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788863565.907873:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788863565.907909:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788863565.907928:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000082f9b856/0x744cd7666bbba8b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8c0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863565.907941:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000082f9b856/0x744cd7666bbba8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8c0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788863565.908026:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788863565.908028:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788863565.908030:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863565.908031:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863565.908033:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863565.908034:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863565.908036:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788863565.908037:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788863565.908039:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788863565.908040:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788863565.908041:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863565.908043:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788863565.908046:0:5821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788863565.908048:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788863565.908050:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788863565.908051:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863565.908052:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863565.908054:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863565.908055:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863565.908056:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788863565.908057:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788863565.908058:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788863565.908059:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788863565.908061:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863565.908062:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788863565.908092:0:5821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788863565.908110:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6a484d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323941632:0@lo:253: 00000100:00100000:0.0:1788863565.908187:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863565.908231:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e65e1e31 going to sleep for 11 seconds 00000100:00100000:3.0:1788863565.909482:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323941632 00000100:00100000:3.0:1788863565.909495:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323941632 00000100:00100000:3.0:1788863565.909557:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788863565.909565:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002426fd09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:5821:x1875759323941632:12345-0@lo:253: 20000000:01000000:3.0:1788863565.909598:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788863565.909616:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788863565.970334:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788863565.970361:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788863565.970479:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788863565.970484:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788863565.970506:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.970525:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006e453aa2/0x744cd7666bbba8a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba89d expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.970533:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.970576:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006e453aa2/0x744cd7666bbba8a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba89d expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863565.970591:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006e453aa2/0x744cd7666bbba8a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba89d expref: 12 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863565.970605:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006cb5802 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875759323941760:0@lo:104: 00000100:00100000:2.0:1788863565.970797:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863565.970893:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set 00000000015e5dc8 going to sleep for 11 seconds 00000100:00100000:3.0:1788863565.971044:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323941760 00000100:00100000:3.0:1788863565.971054:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323941760 00000100:00100000:3.0:1788863565.971106:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863565.971114:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000033161592 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:5856:x1875759323941760:12345-0@lo:104: 00010000:00010000:3.0:1788863565.971126:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba8a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.971188:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788863565.971193:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000033161592 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:5856:x1875759323941760:12345-0@lo:104: Request processed in 80us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863565.971200:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788863565.971245:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863565.971250:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba8a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.971257:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002a643130 already unused, calling callback (00000000538b4a2d) 10000000:00010000:3.0:1788863565.971260:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba8a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.971267:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba8a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863565.971273:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba8a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863565.971278:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788863565.971306:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.971313:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863565.971332:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863565.971447:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006cb5802 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875759323941760:0@lo:104: 00010000:00010000:0.0:1788863565.971473:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.971557:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 000000002a643130/0x744cd7666bbba89d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.971577:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863565.971579:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863565.971580:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863565.971705:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b937024 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323941888:0@lo:103: 00000100:00100000:3.0:1788863565.971740:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863565.972504:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323941888 00000100:00100000:0.0:1788863565.972520:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323941888 00010000:00010000:0.0:1788863565.972548:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006e453aa2/0x744cd7666bbba8a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba89d expref: 13 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863565.972579:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863565.972586:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d56fca04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+13:3307:x1875759323941888:12345-0@lo:103: 00010000:00010000:0.0:1788863565.972601:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863565.972605:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006e453aa2/0x744cd7666bbba8a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba89d expref: 13 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863565.972615:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006e453aa2/0x744cd7666bbba8a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba89d expref: 13 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863565.972630:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006e453aa2/0x744cd7666bbba8a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba89d expref: 13 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863565.972937:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863565.972946:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788863565.973018:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002534727s 00010000:00010000:3.0:1788863565.973029:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.973036:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.973043:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.973050:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.973055:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000021bb2ed1 already unused, calling callback (000000004a72eb6a) 00010000:00010000:3.0:1788863565.973059:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.973066:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.973085:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863565.973098:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863565.973162:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d56fca04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+12:3307:x1875759323941888:12345-0@lo:103: Request processed in 576us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863565.973184:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863565.973230:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b937024 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323941888:0@lo:103: 00010000:00010000:0.0:1788863565.976442:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863565.976478:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863565.976486:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000021bb2ed1/0x744cd7666bbba8d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863566.019231:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002426fd09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+11:5821:x1875759323941632:12345-0@lo:253: Request processed in 109653us (111031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863566.019272:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788863566.021110:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6a484d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:5821:1875759323941632:0@lo:253: 10000000:01000000:2.0:1788863566.021137:0:5821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788863566.021140:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788863566.021143:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788863566.021144:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863566.021145:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863566.021146:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863566.021148:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863566.021149:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788863566.021150:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788863566.021152:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788863566.021153:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788863566.021155:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863566.021157:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788863566.021179:0:5821:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788863566.032371:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788863566.032805:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788863566.033083:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788863566.033257:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788863566.033470:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788863566.033633:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788863566.043597:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788863566.043812:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788863566.044075:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788863566.044254:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788863566.044775:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788863566.044981:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788863566.132695:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788863566.183667:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788863566.183749:0:5873:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788863566.183765:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788863566.184325:0:5874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788863566.189157:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788863566.190650:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788863566.191124:0:5821:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788863566.191142:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788863566.191388:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863566.192355:0:5821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788863566.192910:0:5821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788863566.192938:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788863566.193172:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788863566.194713:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788863566.199392:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788863566.201074:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788863566.205184:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788863566.207628:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788863566.208006:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788863566.208148:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788863566.208302:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788863566.210177:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788863566.210563:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788863566.210702:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788863566.210899:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788863566.211044:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788863566.211187:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788863566.212088:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788863566.212274:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788863566.212434:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788863566.212756:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788863566.212916:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788863566.213086:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788863566.213226:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788863566.213424:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788863566.213559:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788863566.213702:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788863566.213826:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788863566.214023:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788863566.214160:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788863566.214351:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788863566.214503:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788863566.214655:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788863566.214791:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788863566.219982:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788863566.220976:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788863566.221279:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788863566.303308:0:5874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788863566.352774:0:5821:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788863566.352816:0:5821:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffacc5c1da3988 00100000:10000000:1.0:1788863566.352825:0:5821:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788863566.353767:0:5821:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788863566.353787:0:5821:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788863566.353801:0:5821:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788863566.353830:0:5821:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788863566.437294:0:5874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788863566.437408:0:5874:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788863566.437413:0:5874:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788863566.806232:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863567.830279:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863568.856234:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863569.878494:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863570.905013:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788863571.034831:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788863571.034848:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e8bd56cb800 from 3 10000000:01000000:0.0:1788863571.034871:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788863571.035031:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 000000005ef346bc/0x744cd7666bbba8dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863571.035047:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 000000005ef346bc/0x744cd7666bbba8dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863571.035129:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 000000005ef346bc/0x744cd7666bbba8dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863571.035162:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010893c1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323942016:0@lo:101: 00000100:00100000:0.0:1788863571.035250:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863571.036020:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b6b313c going to sleep for 11 seconds 00000100:00100000:3.0:1788863571.036203:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323942016 00000100:00100000:3.0:1788863571.036216:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323942016 00000100:00100000:3.0:1788863571.036431:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788863571.036441:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000011a08c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+11:5838:x1875759323942016:12345-0@lo:101: 00010000:00010000:3.0:1788863571.036462:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863571.036620:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000026b0d30a/0x744cd7666bbba8e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba8dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.036657:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026b0d30a/0x744cd7666bbba8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba8dc expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.036672:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000026b0d30a/0x744cd7666bbba8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba8dc expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.036684:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000026b0d30a, rc 0) 00000100:00100000:3.0:1788863571.036775:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000011a08c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:5838:x1875759323942016:12345-0@lo:101: Request processed in 335us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863571.036783:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788863571.036891:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788863571.036908:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863571.036910:0:36:0:(import.c:65:import_set_state_nolock()) 000000003c546e02 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863571.036993:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003c546e02 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788863571.037030:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dc276e0a x1875759323942144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863571.038229:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010893c1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323942016:0@lo:101: 00010000:00010000:0.0:1788863571.038253:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 000000005ef346bc/0x744cd7666bbba8dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863571.038392:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 000000005ef346bc/0x744cd7666bbba8dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba8e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863571.038602:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc276e0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875759323942144:0@lo:38: 00000100:00100000:3.0:1788863571.038668:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863571.038768:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010893c1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323942272:0@lo:256: 00000100:00100000:0.0:1788863571.038807:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863571.038839:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b6b313c going to sleep for 11 seconds 00000100:00100000:0.0:1788863571.038908:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323942144 00000100:00100000:0.0:1788863571.038915:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323942144 00000100:00100000:0.0:1788863571.039183:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863571.039191:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003b937024 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875759323942144:12345-0@lo:38: 00010000:00080000:0.0:1788863571.039222:0:5842:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000100:00100000:3.0:1788863571.039672:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323942272 00000100:00100000:3.0:1788863571.039679:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323942272 00000100:00100000:3.0:1788863571.039724:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788863571.039731:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000195b0fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:5838:x1875759323942272:12345-0@lo:256: 20000000:01000000:3.0:1788863571.039758:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788863571.039773:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788863571.039777:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788863571.039909:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000195b0fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:5838:x1875759323942272:12345-0@lo:256: Request processed in 179us (1102us total) trans 0 rc 0/0 00000020:00000080:0.0:1788863571.040126:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x744cd7666bbba8ea 00000004:00100000:0.0:1788863571.040191:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788863571.041160:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788863571.041250:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010893c1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323942272:0@lo:256: 00000100:00080000:0.0:1788863571.041630:0:5842:0:(import.c:65:import_set_state_nolock()) 00000000a9be4337 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863571.041728:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003b937024 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875759323942144:12345-0@lo:38: Request processed in 2537us (3060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863571.041739:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788863571.041782:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dc276e0a x1875759323942144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788863571.041799:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788863571.041809:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788863571.041813:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788863571.041815:0:3305:0:(import.c:65:import_set_state_nolock()) 000000003c546e02 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788863571.041822:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc276e0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875759323942144:0@lo:38: 10000000:01000000:3.0:1788863571.042206:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788863571.042215:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 000000005ef346bc/0x744cd7666bbba8dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863571.042226:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 000000005ef346bc/0x744cd7666bbba8dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1788863571.478799:0:6117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788863571.926661:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863572.952952:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863573.977057:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863575.000306:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863576.026158:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863576.153182:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004710c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323942400:0@lo:400: 00000100:00100000:1.0:1788863576.153289:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863576.153358:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863576.153364:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f9688fbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323942528:0@lo:400: 00000100:00100000:1.0:1788863576.153398:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863576.153494:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323942528 00000100:00100000:1.0:1788863576.153513:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323942528 00000100:00100000:1.0:1788863576.153559:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863576.153566:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008c9f95ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323942528:12345-0@lo:400: 00000100:00100000:1.0:1788863576.153619:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008c9f95ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323942528:12345-0@lo:400: Request processed in 53us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863576.153626:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788863576.153668:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f9688fbd x1875759323942528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863576.153681:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f9688fbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323942528:0@lo:400: 00000100:00100000:3.0:1788863576.155913:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323942400 00000100:00100000:3.0:1788863576.155929:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323942400 00000100:00100000:3.0:1788863576.155996:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788863576.156006:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002b27c707 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:3308:x1875759323942400:12345-0@lo:400: 00000100:00100000:3.0:1788863576.156096:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002b27c707 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:3308:x1875759323942400:12345-0@lo:400: Request processed in 92us (2809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863576.156103:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788863576.156721:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004710c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323942400:0@lo:400: 00010000:00010000:2.0:1788863577.048678:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788863577.088605:0:6319:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff09bef690 20000000:00000080:0.0:1788863577.088628:0:6319:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8c01749400 uarg=0000000000000000 20000000:01000000:0.0:1788863577.088668:0:6319:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788863577.088677:0:6319:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788863577.088682:0:6319:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788863577.089418:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788863577.089431:0:6319:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788863577.093980:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863577.094331:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788863577.094390:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788863577.094441:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788863577.094465:0:6319:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788863577.094494:0:6319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863577.094520:0:6319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000996aa20c/0x744cd7666bbba8b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba8ab expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863577.094528:0:6319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863577.094585:0:6319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000996aa20c/0x744cd7666bbba8b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba8ab expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863577.094604:0:6319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000996aa20c/0x744cd7666bbba8b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba8ab expref: 11 pid: 5833 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863577.094624:0:6319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c22ea7c8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1875759323942656:0@lo:104: 00000100:00100000:0.0:1788863577.094697:0:6319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863577.095100:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323942656 00000100:00100000:2.0:1788863577.095111:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323942656 00000100:00100000:2.0:1788863577.095159:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863577.095464:0:6319:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba9cc16c going to sleep for 11 seconds 00000100:00100000:2.0:1788863577.095513:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fd1fff90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+3:6319:x1875759323942656:12345-0@lo:104: 00010000:00010000:2.0:1788863577.095527:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba8b2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.095601:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788863577.095618:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fd1fff90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+3:6319:x1875759323942656:12345-0@lo:104: Request processed in 109us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863577.095625:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788863577.095647:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863577.095652:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba8b2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.095659:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fd1df371 already unused, calling callback (00000000538b4a2d) 10000000:00010000:2.0:1788863577.095662:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba8b2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.095668:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba8b2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863577.095675:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba8b2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863577.095681:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788863577.095714:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8b2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.095722:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863577.095740:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8b2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.095745:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 00000000fd1df371/0x744cd7666bbba8ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8b2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.095766:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863577.095768:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863577.095769:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863577.096093:0:6319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c22ea7c8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1875759323942656:0@lo:104: 00010000:00010000:0.0:1788863577.096290:0:6319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863577.096724:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000acdf170c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323942784:0@lo:103: 00000100:00100000:3.0:1788863577.097464:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863577.097726:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323942784 00000100:00100000:2.0:1788863577.097740:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323942784 00010000:00010000:2.0:1788863577.097794:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000996aa20c/0x744cd7666bbba8b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba8ab expref: 12 pid: 5833 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863577.098066:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863577.098083:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f76a37b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+12:3306:x1875759323942784:12345-0@lo:103: 00010000:00010000:2.0:1788863577.098103:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863577.098108:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000996aa20c/0x744cd7666bbba8b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba8ab expref: 12 pid: 5833 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.098130:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000996aa20c/0x744cd7666bbba8b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba8ab expref: 12 pid: 5833 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.098150:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000996aa20c/0x744cd7666bbba8b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba8ab expref: 12 pid: 5833 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.098173:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.098181:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.098196:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.098203:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.098209:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.098232:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.098238:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000067cbde52 already unused, calling callback (000000004a72eb6a) 00010000:00010000:2.0:1788863577.098243:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.098251:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.098273:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863577.098286:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863577.098352:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f76a37b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+11:3306:x1875759323942784:12345-0@lo:103: Request processed in 271us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863577.098360:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788863577.098412:0:6319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863577.098420:0:6319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863577.098432:0:6319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000067cbde52/0x744cd7666bbba8f1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863577.100104:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000acdf170c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323942784:0@lo:103: 00010000:00010000:1.0:1788863578.070118:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788863578.901962:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788863578.901978:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bd56cb800 from 1 10000000:01000000:3.0:1788863578.901984:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788863578.902063:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 000000009bbc1467/0x744cd7666bbba8f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863578.902077:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 000000009bbc1467/0x744cd7666bbba8f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863578.902089:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 000000009bbc1467/0x744cd7666bbba8f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863578.902118:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee1cd238 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323942912:0@lo:101: 00000100:00100000:3.0:1788863578.902195:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863578.902270:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000affa181f going to sleep for 11 seconds 00000100:00100000:0.0:1788863578.902502:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323942912 00000100:00100000:0.0:1788863578.902512:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323942912 00000100:00100000:0.0:1788863578.902579:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788863578.902587:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000da1ab142 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+11:5838:x1875759323942912:12345-0@lo:101: 00010000:00010000:0.0:1788863578.902603:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863578.902619:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000018e1a57f/0x744cd7666bbba8ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba8f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863578.902642:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000018e1a57f/0x744cd7666bbba8ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba8f8 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863578.902652:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000018e1a57f/0x744cd7666bbba8ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba8f8 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863578.902661:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000018e1a57f, rc 0) 00000100:00100000:0.0:1788863578.902715:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000da1ab142 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:5838:x1875759323942912:12345-0@lo:101: Request processed in 129us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863578.902722:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788863578.902765:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee1cd238 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323942912:0@lo:101: 00010000:00010000:3.0:1788863578.902781:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 000000009bbc1467/0x744cd7666bbba8f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863578.902789:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 000000009bbc1467/0x744cd7666bbba8f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba8ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863578.902882:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee1cd238 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323943040:0@lo:501: 00000100:00100000:3.0:1788863578.902907:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863578.902934:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000affa181f going to sleep for 11 seconds 00000100:00100000:1.0:1788863578.903678:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323943040 00000100:00100000:1.0:1788863578.903685:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323943040 00000100:00100000:1.0:1788863578.903730:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788863578.903738:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000cfd5e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:5838:x1875759323943040:12345-0@lo:501: 00000100:00100000:1.0:1788863578.904123:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000cfd5e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:5838:x1875759323943040:12345-0@lo:501: Request processed in 386us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863578.904131:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788863578.904428:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee1cd238 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323943040:0@lo:501: 00000100:00100000:3.0:1788863578.904474:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee1cd238 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323943168:0@lo:503: 00000100:00100000:3.0:1788863578.904516:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863578.904550:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000affa181f going to sleep for 11 seconds 00000100:00100000:0.0:1788863578.904550:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323943168 00000100:00100000:0.0:1788863578.904558:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323943168 00000100:00100000:0.0:1788863578.904595:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863578.904602:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d7b0a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:5838:x1875759323943168:12345-0@lo:503: 00000100:00100000:0.0:1788863578.904755:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d7b0a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:5838:x1875759323943168:12345-0@lo:503: Request processed in 154us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863578.904765:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788863578.904778:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee1cd238 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323943168:0@lo:503: 00000100:00100000:0.0:1788863578.906654:0:6379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c22ea7c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:6379:1875759323943296:0@lo:502: 00000100:00100000:0.0:1788863578.906761:0:6379:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863578.906806:0:6379:0:(client.c:2716:ptlrpc_set_wait()) set 00000000212004ac going to sleep for 11 seconds 00000100:00100000:1.0:1788863578.907158:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323943296 00000100:00100000:1.0:1788863578.907169:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323943296 00000100:00100000:1.0:1788863578.907231:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788863578.907242:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000368cfa18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:6379:x1875759323943296:12345-0@lo:502: 00000100:00100000:1.0:1788863578.907461:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000368cfa18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:6379:x1875759323943296:12345-0@lo:502: Request processed in 221us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863578.907470:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788863578.907651:0:6379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c22ea7c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:6379:1875759323943296:0@lo:502: 00000020:01000000:0.0:1788863578.907688:0:6379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863578.907700:0:6379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863578.907703:0:6379:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788863578.907712:0:6379:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8bd56cb800 00000020:00000080:0.0:1788863578.907714:0:6379:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788863578.907787:0:6379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:6379:1875759323943424:0@lo:502: 00000100:00100000:0.0:1788863578.907825:0:6379:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863578.907880:0:6379:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2d66f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863578.907930:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323943424 00000100:00100000:3.0:1788863578.907943:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323943424 00000100:00100000:3.0:1788863578.907985:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788863578.907992:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:6379:x1875759323943424:12345-0@lo:502: 00000100:00100000:3.0:1788863578.908117:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:6379:x1875759323943424:12345-0@lo:502: Request processed in 125us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863578.908125:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788863578.908335:0:6379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:6379:1875759323943424:0@lo:502: 00000020:01000000:0.0:1788863578.908356:0:6379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863578.908360:0:6379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863578.908362:0:6379:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788863578.908366:0:6379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788863578.908536:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788863578.908555:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863578.908565:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6e00/0x744cd7666bbba8f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863578.908576:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6e00/0x744cd7666bbba8f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba8ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863579.103490:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863580.118048:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863581.143209:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863581.274144:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863581.274172:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323943552:0@lo:400: 00000100:00100000:2.0:1788863581.274239:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863581.274289:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323943680:0@lo:400: 00000100:00100000:2.0:1788863581.274317:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863581.274346:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323943552 00000100:00100000:2.0:1788863581.274352:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323943552 00000100:00100000:2.0:1788863581.274389:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788863581.274396:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:3306:x1875759323943552:12345-0@lo:400: 00000100:00100000:2.0:1788863581.274435:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:3306:x1875759323943552:12345-0@lo:400: Request processed in 40us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863581.274455:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788863581.274483:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323943680 00000100:00100000:2.0:1788863581.274486:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323943680 00000100:00100000:2.0:1788863581.274507:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863581.274512:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323943680:12345-0@lo:400: 00000100:00100000:2.0:1788863581.274545:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323943680:12345-0@lo:400: Request processed in 32us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863581.274551:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863581.274593:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323943552:0@lo:400: 00010000:00080000:2.0:1788863581.274619:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8bee337b80 x1875759323943680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863581.274630:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323943680:0@lo:400: 00010000:00010000:3.0:1788863582.169167:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863583.193011:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863584.219140:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788863584.418670:0:6675:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788863584.418675:0:6675:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788863584.419137:0:6675:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e8bde7ad800 00000020:01000004:3.0:1788863584.419245:0:6675:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788863584.419258:0:6675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788863584.419272:0:6675:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e8bd0080000) 00000020:00000080:3.0:1788863584.419288:0:6675:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788863584.441667:0:6675:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788863584.442098:0:6675:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788863584.464572:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788863584.471187:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788863584.471221:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788863584.471280:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788863584.471307:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788863584.471684:0:6675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788863584.471694:0:6675:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788863584.471704:0:6675:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x744cd7666bbba90d 00000020:01000004:3.0:1788863584.471711:0:6675:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788863584.471732:0:6675:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788863584.471805:0:6675:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788863584.471812:0:6675:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788863584.471818:0:6675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788863584.471830:0:6675:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e8bd0084d40) 00000020:00000080:3.0:1788863584.471840:0:6675:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788863584.475237:0:6675:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863584.475419:0:6675:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788863584.475425:0:6675:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788863584.477560:0:6675:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788863584.477573:0:6675:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788863584.481120:0:6675:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788863584.481134:0:6675:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788863584.483467:0:6675:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863584.483665:0:6675:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788863584.483671:0:6675:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788863584.484821:0:6675:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788863584.484829:0:6675:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788863584.521516:0:6675:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863584.523091:0:6675:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788863584.523100:0:6675:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788863584.526114:0:6675:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788863584.526128:0:6675:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788863584.531125:0:6675:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788863584.531146:0:6675:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788863584.540385:0:6675:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863584.540591:0:6675:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788863584.540598:0:6675:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788863584.541402:0:6675:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788863584.541411:0:6675:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788863584.608777:0:6675:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863584.609121:0:6675:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788863584.609128:0:6675:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788863584.611066:0:6675:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788863584.611077:0:6675:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788863584.612754:0:6675:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788863584.612783:0:6675:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788863584.612789:0:6675:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788863584.641093:0:6675:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788863584.641131:0:6675:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788863584.641136:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788863584.641138:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788863584.641139:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863584.641141:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863584.641142:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863584.641147:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863584.641148:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788863584.641149:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788863584.641150:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788863584.641152:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863584.641153:0:6675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788863584.641156:0:6675:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788863584.641158:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788863584.641159:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788863584.641160:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863584.641161:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863584.641162:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863584.641163:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863584.641164:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788863584.641165:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788863584.641166:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788863584.641166:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863584.641167:0:6675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788863584.641195:0:6675:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788863584.641214:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323943808:0@lo:253: 00000100:00100000:2.0:1788863584.641288:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863584.641403:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd0e5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863584.641427:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323943808 00000100:00100000:1.0:1788863584.641436:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323943808 00000100:00100000:1.0:1788863584.641489:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863584.641499:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323943808:12345-0@lo:253: 20000000:01000000:1.0:1788863584.641530:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788863584.641535:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788863584.641540:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788863584.641543:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788863584.642711:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863584.644223:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788863584.644251:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788863584.645099:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788863584.645115:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788863584.645162:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788863584.645220:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788863584.646661:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788863584.646692:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:1.0:1788863584.646694:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:1.0:1788863584.646731:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788863584.646739:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788863584.646817:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788863584.646834:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:1.0:1788863584.648121:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788863584.648142:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788863584.648186:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788863584.648382:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788863584.657820:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788863584.657877:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:0.0:1788863584.657881:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:0.0:1788863584.657932:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788863584.657942:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788863584.658175:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788863584.658184:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:0.0:1788863584.658238:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788863584.658271:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788863584.658307:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788863584.658374:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788863584.658406:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788863584.658409:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788863584.658413:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788863584.658432:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788863584.658435:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788863584.658484:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788863584.658487:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788863584.659781:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788863584.660135:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788863584.660180:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788863584.660247:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788863584.660260:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788863584.660262:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788863584.660738:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788863584.660798:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788863584.660882:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788863584.671095:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788863584.671171:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788863584.671259:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788863584.671281:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788863584.671284:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788863584.675579:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788863584.676046:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788863584.676112:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788863584.679692:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788863584.679789:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788863584.679846:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788863584.680057:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788863584.680060:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788863584.680073:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788863584.680101:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.680121:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba82d expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.680145:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc166a400/0x744cd7666bbba850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba849 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.680162:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc166a800/0x744cd7666bbba8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba8b9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.680169:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.680210:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc166a800/0x744cd7666bbba8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba8b9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.680226:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc166a800/0x744cd7666bbba8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba8b9 expref: 12 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863584.680243:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323943936:0@lo:104: 00000100:00100000:2.0:1788863584.680311:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863584.680542:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc166a400/0x744cd7666bbba850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba849 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.680551:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc166a400/0x744cd7666bbba850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba849 expref: 12 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863584.680560:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee336a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323944064:0@lo:104: 00000100:00100000:2.0:1788863584.680584:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863584.682026:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba82d expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.682044:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba834 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba82d expref: 12 pid: 5832 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863584.682073:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323944192:0@lo:104: 00000100:00100000:2.0:1788863584.682122:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863584.682430:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323943936 00000100:00100000:1.0:1788863584.682440:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323943936 00000100:00100000:1.0:1788863584.682505:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323944064 00000100:00100000:1.0:1788863584.682509:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323944064 00000100:00100000:1.0:1788863584.682524:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863584.682532:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+4:5832:x1875759323943936:12345-0@lo:104: 00010000:00010000:1.0:1788863584.682545:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1e00/0x744cd7666bbba8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba8c0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.682611:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863584.682618:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+4:5832:x1875759323943936:12345-0@lo:104: Request processed in 87us (2308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863584.682636:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863584.682656:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863584.682662:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:5832:x1875759323944064:12345-0@lo:104: 00010000:00010000:1.0:1788863584.682669:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba850 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.682719:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788863584.682725:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:5832:x1875759323944064:12345-0@lo:104: Request processed in 64us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863584.682731:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788863584.682750:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863584.682756:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1e00/0x744cd7666bbba8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba8c0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.682772:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc13a1e00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:1.0:1788863584.682776:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1e00/0x744cd7666bbba8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba8c0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.682786:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1e00/0x744cd7666bbba8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba8c0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863584.682793:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1e00/0x744cd7666bbba8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba8c0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863584.682799:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863584.682872:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1e00/0x744cd7666bbba8b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8c0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.682879:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863584.682899:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1e00/0x744cd7666bbba8b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8c0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.682906:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1e00/0x744cd7666bbba8b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8c0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.682920:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863584.682923:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba850 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.682929:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc13a0200 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:1.0:1788863584.682937:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba850 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.682957:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba850 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863584.682964:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba850 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863584.682970:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863584.682985:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba850 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.682991:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863584.683009:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba849 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba850 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.683017:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba850 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.683027:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863584.683029:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863584.683030:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863584.683053:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863584.683057:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323944320:0@lo:103: 00000100:00100000:0.0:1788863584.683065:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863584.683081:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323944448:0@lo:103: 00000100:00100000:3.0:1788863584.683409:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323944192 00000100:00100000:3.0:1788863584.683416:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323944192 00000100:00100000:1.0:1788863584.683457:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.683497:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788863584.683505:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+3:5832:x1875759323944192:12345-0@lo:104: 00010000:00010000:3.0:1788863584.683515:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0a00/0x744cd7666bbba82d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba834 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.683563:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788863584.683568:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+3:5832:x1875759323944192:12345-0@lo:104: Request processed in 65us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.683575:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788863584.683746:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323944320 00000100:00100000:3.0:1788863584.683751:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323944320 00010000:00010000:3.0:1788863584.683770:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc166a800/0x744cd7666bbba8c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba8b9 expref: 13 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.683786:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863584.683792:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0a00/0x744cd7666bbba82d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba834 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.683798:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc13a0a00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:1.0:1788863584.683801:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0a00/0x744cd7666bbba82d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba834 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.683820:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0a00/0x744cd7666bbba82d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba834 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.683917:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863584.683925:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+13:3309:x1875759323944320:12345-0@lo:103: 00010000:00010000:3.0:1788863584.683936:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863584.683941:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc166a800/0x744cd7666bbba8c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba8b9 expref: 13 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.683952:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc166a800/0x744cd7666bbba8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba8b9 expref: 13 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.683968:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863584.683999:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+13:3309:x1875759323944320:12345-0@lo:103: Request processed in 75us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.684005:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:00010000:1.0:1788863584.684103:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0a00/0x744cd7666bbba82d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba834 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863584.684111:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863584.684145:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0a00/0x744cd7666bbba82d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba834 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.684152:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863584.684163:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0a00/0x744cd7666bbba82d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba834 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.684170:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0a00/0x744cd7666bbba82d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba834 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.684187:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863584.684188:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863584.684190:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863584.684196:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863584.684207:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323944576:0@lo:103: 00000100:00100000:1.0:1788863584.684234:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863584.684274:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323944576 00000100:00100000:1.0:1788863584.684278:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323944576 00010000:00010000:1.0:1788863584.684293:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba834 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba82d expref: 13 pid: 5832 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863584.684311:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863584.684316:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+13:3306:x1875759323944576:12345-0@lo:103: 00010000:00010000:1.0:1788863584.684403:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863584.684410:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba834 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba82d expref: 13 pid: 5832 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.684419:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba834 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba82d expref: 13 pid: 5832 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.684429:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863584.684455:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+13:3306:x1875759323944576:12345-0@lo:103: Request processed in 139us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863584.684461:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863584.684492:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323944576:0@lo:103: 00000100:00100000:1.0:1788863584.684518:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323944320:0@lo:103: 00000100:00100000:0.0:1788863584.684666:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863584.684781:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd0e5de40 going to sleep for 11 seconds 00010000:00010000:2.0:1788863584.684796:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc166a800/0x744cd7666bbba8c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba8b9 expref: 12 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863584.684807:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323943936:0@lo:104: 00000100:00100000:2.0:1788863584.684816:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee336a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323944064:0@lo:104: 00010000:00010000:2.0:1788863584.684822:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba82d expref: 11 pid: 5832 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863584.685115:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323944192:0@lo:104: 00010000:00010000:2.0:1788863584.685139:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.685236:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323944448 00000100:00100000:3.0:1788863584.685242:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323944448 00010000:00010000:3.0:1788863584.685266:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc166a400/0x744cd7666bbba850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba849 expref: 11 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.685323:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788863584.685342:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+11:3307:x1875759323944448:12345-0@lo:103: 00010000:00010000:3.0:1788863584.685362:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863584.685367:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc166a400/0x744cd7666bbba850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba849 expref: 11 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.685376:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc166a400/0x744cd7666bbba850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba849 expref: 11 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.685389:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc166a400/0x744cd7666bbba850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba849 expref: 11 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.685404:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.685413:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.685427:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.685434:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.685441:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.685448:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.685454:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166bc00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863584.685458:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.685479:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.685498:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.685509:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863584.685553:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+10:3307:x1875759323944448:12345-0@lo:103: Request processed in 222us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.685560:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788863584.685602:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.685610:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.685616:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc166bc00/0x744cd7666bbba91b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788863584.685643:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788863584.685931:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323944448:0@lo:103: 00000100:00100000:1.0:1788863584.749902:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+9:6675:x1875759323943808:12345-0@lo:253: Request processed in 108392us (108601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863584.749922:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788863584.750100:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323943808:0@lo:253: 10000000:01000000:3.0:1788863584.750116:0:6675:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788863584.750120:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788863584.750122:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788863584.750123:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863584.750124:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788863584.750126:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863584.750127:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863584.750129:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788863584.750130:0:6675:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788863584.750132:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863584.750133:0:6675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788863584.750156:0:6675:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8bde7ad800 from lustre-OST0000 10000000:01000000:3.0:1788863584.750187:0:6675:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788863584.750190:0:6675:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788863584.750197:0:6675:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e8bc84bb380 local copy 10000000:01000000:3.0:1788863584.750202:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788863584.750248:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.750264:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.750290:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.750312:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee494380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323944704:0@lo:101: 00000100:00100000:3.0:1788863584.750427:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.750493:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2d66cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863584.750566:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323944704 00000100:00100000:0.0:1788863584.750574:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323944704 00000100:00100000:0.0:1788863584.750632:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788863584.750643:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+9:6675:x1875759323944704:12345-0@lo:101: 00010000:00010000:0.0:1788863584.750657:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863584.750674:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba922 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.750706:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba922 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.750717:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba922 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.750728:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031e00, rc 0) 00000100:00100000:0.0:1788863584.750768:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+10:6675:x1875759323944704:12345-0@lo:101: Request processed in 127us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863584.750775:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863584.750903:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee494380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323944704:0@lo:101: 00010000:00010000:1.0:1788863584.750917:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x744cd7666bbba929 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.750927:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x744cd7666bbba929 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863584.751045:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323944832:0@lo:501: 00000100:00100000:1.0:1788863584.751073:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863584.751103:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc9656780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863584.751222:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323944832 00000100:00100000:0.0:1788863584.751227:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323944832 00000100:00100000:0.0:1788863584.751259:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788863584.751267:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+10:6675:x1875759323944832:12345-0@lo:501: 00000100:00100000:0.0:1788863584.751501:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+10:6675:x1875759323944832:12345-0@lo:501: Request processed in 233us (426us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788863584.751508:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788863584.751655:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323944832:0@lo:501: 10000000:01000000:3.0:1788863584.751669:0:6675:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788863584.751696:0:6675:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788863584.751702:0:6675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x744cd7666bbba929 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.751710:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x744cd7666bbba929 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.751716:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x744cd7666bbba929 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.751736:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788863584.751755:0:6675:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8bde7ad800 10000000:01000000:3.0:1788863584.751760:0:6675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788863584.751765:0:6675:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e8bc84bb380 10000000:01000000:3.0:1788863584.751767:0:6675:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788863584.751770:0:6675:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e8bc84bb380 from 1 10000000:01000000:3.0:1788863584.751773:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788863584.751794:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7400/0x744cd7666bbba930 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.751814:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7400/0x744cd7666bbba930 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.751824:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7400/0x744cd7666bbba930 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.751836:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323944960:0@lo:101: 00000100:00100000:3.0:1788863584.751900:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.751923:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2d66a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.751936:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323944960 00000100:00100000:3.0:1788863584.751940:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323944960 00000100:00100000:3.0:1788863584.751962:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788863584.751968:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+10:6675:x1875759323944960:12345-0@lo:101: 00010000:00010000:3.0:1788863584.751989:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863584.751999:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8c021c7a00/0x744cd7666bbba937 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba930 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.752014:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8c021c7a00/0x744cd7666bbba937 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba930 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.752023:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8c021c7a00/0x744cd7666bbba937 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba930 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.752031:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8c021c7a00, rc 0) 00000100:00100000:3.0:1788863584.752059:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+11:6675:x1875759323944960:12345-0@lo:101: Request processed in 91us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.752064:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788863584.752093:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323944960:0@lo:101: 00010000:00010000:3.0:1788863584.752110:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7400/0x744cd7666bbba930 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba937 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.752118:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7400/0x744cd7666bbba930 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba937 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863584.752133:0:6675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788863584.752141:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7400/0x744cd7666bbba930 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba937 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.752148:0:6675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7400/0x744cd7666bbba930 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba937 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863584.752153:0:6675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788863584.752157:0:6675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788863584.752160:0:6675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788863584.752162:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788863584.752175:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.752182:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.752190:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.752201:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945088:0@lo:101: 00000100:00100000:3.0:1788863584.752228:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.752240:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2d66a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.752257:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323945088 00000100:00100000:3.0:1788863584.752265:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323945088 00000100:00100000:3.0:1788863584.752281:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788863584.752287:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+11:6675:x1875759323945088:12345-0@lo:101: 00010000:00010000:3.0:1788863584.752294:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863584.752301:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbba945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba93e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.752313:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbba945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba93e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.752320:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbba945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba93e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.752338:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8c021c7e00, rc 0) 00000100:00100000:3.0:1788863584.752366:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323945088:12345-0@lo:101: Request processed in 79us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.752372:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788863584.752401:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945088:0@lo:101: 00010000:00010000:3.0:1788863584.752412:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba945 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.752419:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba945 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.752476:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945216:0@lo:501: 00000100:00100000:3.0:1788863584.752500:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.752512:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2d66a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.752524:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323945216 00000100:00100000:3.0:1788863584.752528:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323945216 00000100:00100000:3.0:1788863584.752552:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788863584.752557:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323945216:12345-0@lo:501: 00000100:00100000:3.0:1788863584.752744:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323945216:12345-0@lo:501: Request processed in 186us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.752751:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788863584.752782:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945216:0@lo:501: 00000100:00100000:3.0:1788863584.752806:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945344:0@lo:503: 00000100:00100000:3.0:1788863584.752845:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.752889:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2d66a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.752902:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323945344 00000100:00100000:3.0:1788863584.752906:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323945344 00000100:00100000:3.0:1788863584.752923:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788863584.752928:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323945344:12345-0@lo:503: 00000100:00100000:3.0:1788863584.753073:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323945344:12345-0@lo:503: Request processed in 143us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.753080:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788863584.753121:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945344:0@lo:503: 00000040:00080000:3.0:1788863584.753391:0:6675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788863584.753452:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945472:0@lo:502: 00000100:00100000:3.0:1788863584.753490:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.753505:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2d66a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.753520:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323945472 00000100:00100000:3.0:1788863584.753523:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323945472 00000100:00100000:3.0:1788863584.753541:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788863584.753546:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323945472:12345-0@lo:502: 00000100:00100000:3.0:1788863584.753689:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323945472:12345-0@lo:502: Request processed in 142us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.753702:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788863584.753740:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945472:0@lo:502: 00000040:00080000:3.0:1788863584.754013:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788863584.754063:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788863584.754099:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788863584.754145:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788863584.754182:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788863584.754217:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788863584.754240:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945600:0@lo:502: 00000100:00100000:3.0:1788863584.754278:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.754303:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2d66a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.754318:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323945600 00000100:00100000:3.0:1788863584.754323:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323945600 00000100:00100000:3.0:1788863584.754343:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788863584.754349:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323945600:12345-0@lo:502: 00000100:00100000:3.0:1788863584.754470:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323945600:12345-0@lo:502: Request processed in 120us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.754476:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1788863584.754789:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863584.754801:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x744cd7666bbba929 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.754812:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8c021c6200 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:0.0:1788863584.754817:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x744cd7666bbba929 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.754828:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x744cd7666bbba929 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863584.754848:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x744cd7666bbba929 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863584.754885:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788863584.754916:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x744cd7666bbba929 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.754921:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863584.754947:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x744cd7666bbba929 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.754955:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba922 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x744cd7666bbba929 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.754974:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863584.754987:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863584.754989:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863584.755003:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323945728:0@lo:103: 00000100:00100000:0.0:1788863584.755036:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863584.755076:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323945728 00000100:00100000:0.0:1788863584.755079:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323945728 00000100:00100000:0.0:1788863584.755113:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863584.755120:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+13:3308:x1875759323945728:12345-0@lo:103: 00010000:00010000:0.0:1788863584.755132:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863584.755148:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbba922 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.755164:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863584.755201:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+12:3308:x1875759323945728:12345-0@lo:103: Request processed in 81us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863584.755207:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863584.755238:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323945728:0@lo:103: 00000100:00100000:3.0:1788863584.755670:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945600:0@lo:502: 00000040:00080000:3.0:1788863584.755802:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788863584.755815:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788863584.757175:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788863584.757186:0:6694:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788863584.757195:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863584.757207:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788863584.757215:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788863584.757232:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e8bd224b380) 00000020:00000080:2.0:1788863584.757259:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788863584.757265:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788863584.757441:0:6694:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8bde7ad800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788863584.757450:0:6694:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788863584.757458:0:6694:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x744cd7666bbba953 00010000:00010000:3.0:1788863584.762788:0:6694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788863584.763317:0:6694:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788863584.766471:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788863584.767245:0:6694:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788863584.775571:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788863584.780173:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788863584.782508:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788863584.782522:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863584.782530:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863584.782532:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788863584.782538:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863584.782542:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863584.782543:0:6694:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788863584.782546:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788863584.782548:0:6694:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788863584.782609:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863584.782612:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863584.782614:0:6694:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788863584.782617:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788863584.783194:0:6675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788863584.783219:0:6675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788863584.783242:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba945 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.783255:0:6675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba945 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863584.783262:0:6675:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bde7ad800 from 1 10000000:01000000:2.0:1788863584.783266:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788863584.783299:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.783307:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.783318:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863584.783409:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945856:0@lo:101: 00000100:00100000:2.0:1788863584.783477:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863584.783517:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd0e5d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863584.783754:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323945856 00000100:00100000:0.0:1788863584.783762:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323945856 00000100:00100000:0.0:1788863584.785007:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788863584.785022:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+11:6675:x1875759323945856:12345-0@lo:101: 00010000:00010000:0.0:1788863584.785038:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863584.785056:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba961 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba95a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.785081:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba95a expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.785091:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba95a expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.785111:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031e00, rc 0) 00000100:00100000:0.0:1788863584.785177:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323945856:12345-0@lo:101: Request processed in 159us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863584.785184:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788863584.785264:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945856:0@lo:101: 00010000:00010000:3.0:1788863584.785288:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba961 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.785297:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba961 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.785415:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945984:0@lo:501: 00000100:00100000:3.0:1788863584.785444:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.785815:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd28756c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863584.785980:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323945984 00000100:00100000:2.0:1788863584.785986:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323945984 00000100:00100000:2.0:1788863584.786013:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788863584.786020:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323945984:12345-0@lo:501: 00000100:00100000:2.0:1788863584.786255:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323945984:12345-0@lo:501: Request processed in 234us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863584.786262:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788863584.786438:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323945984:0@lo:501: 00000100:00100000:3.0:1788863584.786478:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946112:0@lo:503: 00000100:00100000:3.0:1788863584.786518:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.786545:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd28756c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863584.786601:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323946112 00000100:00100000:2.0:1788863584.786605:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323946112 00000100:00100000:2.0:1788863584.786621:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788863584.786639:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323946112:12345-0@lo:503: 00000100:00100000:2.0:1788863584.786901:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323946112:12345-0@lo:503: Request processed in 262us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863584.786908:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788863584.787057:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946112:0@lo:503: 00000040:00080000:3.0:1788863584.787348:0:6675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788863584.787411:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946240:0@lo:502: 00000100:00100000:3.0:1788863584.787447:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.787467:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcb084240 going to sleep for 11 seconds 00000100:00100000:2.0:1788863584.787644:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323946240 00000100:00100000:2.0:1788863584.787649:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323946240 00000100:00100000:2.0:1788863584.787683:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788863584.787691:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323946240:12345-0@lo:502: 00000100:00100000:2.0:1788863584.787844:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323946240:12345-0@lo:502: Request processed in 154us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863584.787877:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788863584.788021:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946240:0@lo:502: 00000040:00080000:3.0:1788863584.788269:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788863584.788320:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788863584.788358:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946368:0@lo:502: 00000100:00100000:3.0:1788863584.788394:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.788414:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcb084240 going to sleep for 11 seconds 00000100:00100000:2.0:1788863584.788581:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323946368 00000100:00100000:2.0:1788863584.788587:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323946368 00000100:00100000:2.0:1788863584.788610:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788863584.788617:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323946368:12345-0@lo:502: 00000100:00100000:2.0:1788863584.788783:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323946368:12345-0@lo:502: Request processed in 165us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863584.788804:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788863584.788993:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946368:0@lo:502: 00000040:00080000:3.0:1788863584.789080:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788863584.789089:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788863584.792598:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863584.792611:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863584.792614:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788863584.792636:0:6698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8bde7ad800 00000020:00000080:3.0:1788863584.792640:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788863584.792662:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863584.792665:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863584.792666:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788863584.792669:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788863584.792726:0:6675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788863584.792753:0:6675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863584.792776:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba961 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.792790:0:6675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba961 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863584.792827:0:6675:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788863584.792829:0:6675:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8bde7ad800 10000000:01000000:3.0:1788863584.792832:0:6675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8bde7ad800 10000000:01000000:3.0:1788863584.792836:0:6675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788863584.792842:0:6675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e8bde7ad800 from 1 10000000:01000000:3.0:1788863584.792845:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788863584.792898:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.792907:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.792932:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.792957:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946496:0@lo:101: 00000100:00100000:3.0:1788863584.793099:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.793140:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd28756c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863584.793449:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323946496 00000100:00100000:1.0:1788863584.793464:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323946496 00000100:00100000:1.0:1788863584.793515:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788863584.793524:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323946496:12345-0@lo:101: 00010000:00010000:1.0:1788863584.793536:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863584.793550:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbba96f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba968 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.793572:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbba96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba968 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.793582:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbba96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba968 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.793590:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc13a0a00, rc 0) 00000100:00100000:1.0:1788863584.793643:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:6675:x1875759323946496:12345-0@lo:101: Request processed in 119us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863584.793650:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788863584.794239:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946496:0@lo:101: 00010000:00010000:3.0:1788863584.794257:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba96f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.794267:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba96f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.794508:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946624:0@lo:501: 00000100:00100000:3.0:1788863584.794548:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.794582:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd28756c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863584.794929:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323946624 00000100:00100000:1.0:1788863584.794936:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323946624 00000100:00100000:1.0:1788863584.795044:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788863584.795053:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:6675:x1875759323946624:12345-0@lo:501: 00000100:00100000:1.0:1788863584.795293:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:6675:x1875759323946624:12345-0@lo:501: Request processed in 241us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863584.795300:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788863584.796173:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946624:0@lo:501: 00000100:00100000:3.0:1788863584.796217:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946752:0@lo:503: 00000100:00100000:3.0:1788863584.796263:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.796297:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd28756c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863584.796404:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323946752 00000100:00100000:2.0:1788863584.796410:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323946752 00000100:00100000:2.0:1788863584.796439:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788863584.796446:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:6675:x1875759323946752:12345-0@lo:503: 00000100:00100000:2.0:1788863584.796598:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:6675:x1875759323946752:12345-0@lo:503: Request processed in 152us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863584.796605:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863584.796689:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946752:0@lo:503: 00000040:00080000:2.0:1788863584.797488:0:6675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788863584.797563:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee336a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946880:0@lo:502: 00000100:00100000:2.0:1788863584.797608:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863584.797650:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf117b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.797697:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323946880 00000100:00100000:3.0:1788863584.797702:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323946880 00000100:00100000:3.0:1788863584.797736:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788863584.797743:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:6675:x1875759323946880:12345-0@lo:502: 00000100:00100000:3.0:1788863584.798668:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:6675:x1875759323946880:12345-0@lo:502: Request processed in 922us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.798677:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788863584.798884:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee336a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323946880:0@lo:502: 00000040:00080000:2.0:1788863584.799297:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788863584.799441:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788863584.799494:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788863584.799543:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788863584.799581:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788863584.799644:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788863584.799682:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788863584.799716:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788863584.799786:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788863584.799827:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788863584.800056:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788863584.800112:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788863584.800152:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788863584.800187:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788863584.800235:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788863584.800283:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788863584.800322:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788863584.800457:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788863584.800510:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788863584.800549:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788863584.800597:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788863584.800646:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788863584.800679:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788863584.800728:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788863584.800766:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788863584.800802:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788863584.801040:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788863584.801084:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788863584.801130:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee336a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323947008:0@lo:502: 00000100:00100000:2.0:1788863584.801200:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863584.801298:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf117b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.803565:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323947008 00000100:00100000:3.0:1788863584.803579:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323947008 00000100:00100000:3.0:1788863584.803636:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788863584.803645:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:6675:x1875759323947008:12345-0@lo:502: 00000100:00100000:3.0:1788863584.803947:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:6675:x1875759323947008:12345-0@lo:502: Request processed in 303us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.803956:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788863584.804140:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee336a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323947008:0@lo:502: 00000040:00080000:0.0:1788863584.804260:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788863584.804278:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788863584.804941:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788863584.804957:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e8bd2248000) 00000020:00000080:2.0:1788863584.805048:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788863584.805130:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8bde7ad800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788863584.805134:0:6699:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8bde7ad800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788863584.805137:0:6699:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8bde7ad800 3 00010000:00080000:2.0:1788863584.805168:0:6699:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8bff594800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1788863584.809144:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788863584.809707:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788863584.809750:0:6699:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788863584.809769:0:6699:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x744cd7666bbba97d 00000100:00080000:2.0:1788863584.809782:0:6699:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788863584.809797:0:6699:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e8bff594800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788863584.809845:0:6699:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bee337480 x1875759323947136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788863584.809918:0:6699:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788863584.810349:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875759323947136:0@lo:38: 00000100:00100000:1.0:1788863584.810420:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.810581:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323947136 00000100:00100000:3.0:1788863584.810588:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323947136 00000100:00100000:3.0:1788863584.810620:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863584.810640:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875759323947136:12345-0@lo:38: 00010000:00080000:3.0:1788863584.810662:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:3.0:1788863584.810694:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x744cd7666bbba984 00000004:00100000:3.0:1788863584.810709:0:5840:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788863584.810741:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2cc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863584.810800:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875759323947136:12345-0@lo:38: Request processed in 160us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.810808:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788863584.811074:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8bee337480 x1875759323947136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863584.811099:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788863584.811106:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788863584.811114:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788863584.811118:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788863584.811120:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff594800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788863584.811127:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875759323947136:0@lo:38: 00000100:00100000:1.0:1788863584.811965:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863584.811991:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323947264:0@lo:400: 00000100:00100000:1.0:1788863584.812043:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863584.812197:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323947264 00000100:00100000:2.0:1788863584.812205:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323947264 00000100:00100000:2.0:1788863584.812251:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863584.812260:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323947264:12345-0@lo:400: 00000100:00100000:2.0:1788863584.812317:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323947264:12345-0@lo:400: Request processed in 59us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863584.812325:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788863584.812486:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8bee336d80 x1875759323947264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863584.812500:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323947264:0@lo:400: 00000040:00080000:2.0:1788863584.814501:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788863584.814889:0:6675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788863584.814915:0:6675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788863584.814931:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba96f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.814942:0:6675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba96f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788863584.814998:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788863584.815001:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788863584.815002:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863584.815003:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863584.815004:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863584.815006:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863584.815007:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863584.815009:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788863584.815015:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788863584.815016:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863584.815017:0:6675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788863584.815021:0:6675:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788863584.815023:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788863584.815024:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788863584.815025:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863584.815026:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863584.815027:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863584.815027:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863584.815028:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863584.815029:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788863584.815030:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788863584.815030:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863584.815031:0:6675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788863584.815056:0:6675:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788863584.815074:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323947392:0@lo:253: 00000100:00100000:1.0:1788863584.815144:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863584.815179:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc9656480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.815310:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323947392 00000100:00100000:3.0:1788863584.815317:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323947392 00000100:00100000:3.0:1788863584.815375:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788863584.815386:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:6675:x1875759323947392:12345-0@lo:253: 20000000:01000000:3.0:1788863584.815413:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788863584.815427:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788863584.855503:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788863584.855517:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788863584.855549:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788863584.855553:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788863584.855578:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.855600:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8c021c6800/0x744cd7666bbba8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba8dc expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.855609:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.855658:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8c021c6800/0x744cd7666bbba8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba8dc expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.855981:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8c021c6800/0x744cd7666bbba8e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba8dc expref: 13 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.855998:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875759323947520:0@lo:104: 00000100:00100000:3.0:1788863584.856783:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.856880:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc01a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863584.859815:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323947520 00000100:00100000:2.0:1788863584.859831:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323947520 00000100:00100000:2.0:1788863584.859908:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788863584.859920:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee495c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+3:5856:x1875759323947520:12345-0@lo:104: 00010000:00010000:2.0:1788863584.859938:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbba8dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba8e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.860044:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788863584.860050:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee495c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+3:5856:x1875759323947520:12345-0@lo:104: Request processed in 134us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863584.860057:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788863584.860080:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863584.860086:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbba8dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba8e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.860094:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031200 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:2.0:1788863584.860099:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbba8dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba8e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.860145:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbba8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba8e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863584.860153:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbba8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba8e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863584.860159:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863584.860195:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbba8dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.860202:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863584.860223:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbba8dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.860230:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbba8dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.860249:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863584.860250:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863584.860252:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863584.860274:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323947648:0@lo:103: 00000100:00100000:2.0:1788863584.860315:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863584.860433:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875759323947520:0@lo:104: 00010000:00010000:1.0:1788863584.860457:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.860593:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323947648 00000100:00100000:3.0:1788863584.860598:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323947648 00010000:00010000:3.0:1788863584.860620:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8c021c6800/0x744cd7666bbba8e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba8dc expref: 14 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.860654:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863584.860661:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2886050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+14:3306:x1875759323947648:12345-0@lo:103: 00010000:00010000:3.0:1788863584.860672:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863584.860678:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8c021c6800/0x744cd7666bbba8e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba8dc expref: 14 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860696:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8c021c6800/0x744cd7666bbba8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba8dc expref: 14 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860711:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8c021c6800/0x744cd7666bbba8e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba8dc expref: 14 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860726:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860735:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788863584.860749:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005196512s 00010000:00010000:3.0:1788863584.860754:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860761:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860768:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860774:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860779:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8c021c6200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863584.860783:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860790:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860809:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860819:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863584.860888:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2886050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+13:3306:x1875759323947648:12345-0@lo:103: Request processed in 228us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.860895:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863584.860955:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323947648:0@lo:103: 00010000:00010000:3.0:1788863584.860973:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860980:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.860986:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8c021c6200/0x744cd7666bbba98b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.867556:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:6675:x1875759323947392:12345-0@lo:253: Request processed in 52162us (52403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.867571:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788863584.867761:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:6675:1875759323947392:0@lo:253: 10000000:01000000:1.0:1788863584.867779:0:6675:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788863584.867782:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788863584.867784:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788863584.867785:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863584.867786:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863584.867787:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863584.867788:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863584.867790:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863584.867791:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788863584.867793:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788863584.867794:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863584.867795:0:6675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788863584.867823:0:6675:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788863584.886842:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788863584.887272:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788863584.887487:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788863584.887666:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788863584.887912:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788863584.889309:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788863584.890463:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:1.0:1788863584.891401:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788863584.891411:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e8bd56cb800 from 21 10000000:01000000:1.0:1788863584.891417:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788863584.891466:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.891480:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863584.891494:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863584.891519:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323947776:0@lo:101: 00000100:00100000:1.0:1788863584.891595:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863584.891661:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcb0d2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863584.893148:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323947776 00000100:00100000:2.0:1788863584.893165:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323947776 00000100:00100000:2.0:1788863584.893235:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788863584.893247:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:5838:x1875759323947776:12345-0@lo:101: 00010000:00010000:2.0:1788863584.893271:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863584.893292:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba992 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.893339:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba992 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.893349:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba992 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863584.893359:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc166b600, rc 0) 00000100:00100000:2.0:1788863584.893459:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323947776:12345-0@lo:101: Request processed in 214us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863584.893466:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788863584.893606:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323947776:0@lo:101: 00010000:00010000:0.0:1788863584.893633:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba999 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.893643:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba999 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863584.893710:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323947904:0@lo:501: 00000100:00100000:0.0:1788863584.893753:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863584.893786:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2d66c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863584.893831:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323947904 00000100:00100000:2.0:1788863584.893835:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323947904 00000100:00100000:2.0:1788863584.893944:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788863584.893951:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323947904:12345-0@lo:501: 00000100:00100000:2.0:1788863584.894192:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323947904:12345-0@lo:501: Request processed in 241us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863584.894198:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788863584.902479:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323947904:0@lo:501: 00000100:00100000:0.0:1788863584.903303:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323948032:0@lo:503: 00000100:00100000:0.0:1788863584.903449:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863584.903561:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2d66c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863584.903585:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323948032 00000100:00100000:0.0:1788863584.903593:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323948032 00000100:00100000:0.0:1788863584.903653:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788863584.903671:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323948032:12345-0@lo:503: 00000100:00100000:0.0:1788863584.903901:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323948032:12345-0@lo:503: Request processed in 232us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863584.903910:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788863584.904036:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323948032:0@lo:503: 00000100:00100000:3.0:1788863584.921466:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:6703:1875759323948160:0@lo:502: 00000100:00100000:3.0:1788863584.921638:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.921688:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323948160 00000100:00100000:3.0:1788863584.921696:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323948160 00000100:00100000:3.0:1788863584.921744:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788863584.921752:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:6703:x1875759323948160:12345-0@lo:502: 00000100:00100000:3.0:1788863584.921974:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:6703:x1875759323948160:12345-0@lo:502: Request processed in 222us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.921988:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788863584.922048:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc01540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.922071:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:6703:1875759323948160:0@lo:502: 00000100:00100000:3.0:1788863584.922121:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:6703:1875759323948288:0@lo:502: 00000100:00100000:3.0:1788863584.922151:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.922173:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323948288 00000100:00100000:3.0:1788863584.922177:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323948288 00000100:00100000:3.0:1788863584.923005:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788863584.923014:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:6703:x1875759323948288:12345-0@lo:502: 00000100:00100000:3.0:1788863584.923561:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:6703:x1875759323948288:12345-0@lo:502: Request processed in 546us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.923568:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788863584.923615:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc01540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.923644:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:6703:1875759323948288:0@lo:502: 00000040:00080000:3.0:1788863584.923674:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788863584.923750:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788863584.923773:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788863584.923783:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba999 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.923795:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba999 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863584.923803:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788863584.923806:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e8bd56cb800 from 4 10000000:01000000:3.0:1788863584.923809:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788863584.923843:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.923882:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.923893:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.923910:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323948416:0@lo:101: 00000100:00100000:3.0:1788863584.923942:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.925398:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc01540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863584.925745:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323948416 00000100:00100000:0.0:1788863584.925756:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323948416 00000100:00100000:0.0:1788863584.925805:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788863584.925816:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323948416:12345-0@lo:101: 00010000:00010000:0.0:1788863584.925830:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863584.925873:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbba9a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba9a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.925900:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbba9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba9a0 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.925909:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbba9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba9a0 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863584.925918:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031400, rc 0) 00000100:00100000:3.0:1788863584.926313:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323948416:0@lo:101: 00010000:00010000:3.0:1788863584.926332:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.926341:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.926399:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323948544:0@lo:256: 00000100:00100000:3.0:1788863584.926921:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.926954:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc01540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.926972:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323948544 00000100:00100000:3.0:1788863584.926977:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323948544 00000100:00100000:3.0:1788863584.927006:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788863584.927013:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323948544:12345-0@lo:256: 20000000:01000000:3.0:1788863584.927027:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788863584.927045:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788863584.927048:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788863584.927124:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323948544:12345-0@lo:256: Request processed in 111us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.927136:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788863584.927171:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323948544:0@lo:256: 10000000:01000000:3.0:1788863584.927795:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788863584.927804:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.927814:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863584.927823:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788863584.927826:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788863584.927829:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788863584.927881:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.927889:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.927899:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.927914:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323948672:0@lo:101: 00000100:00100000:3.0:1788863584.927964:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.927995:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc01540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.928013:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323948672 00000100:00100000:3.0:1788863584.928017:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323948672 00000100:00100000:3.0:1788863584.928043:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788863584.928049:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323948672:12345-0@lo:101: 00010000:00010000:3.0:1788863584.928064:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863584.929062:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bffc17c00/0x744cd7666bbba9b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba9ae expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.929107:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc17c00/0x744cd7666bbba9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba9ae expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.929121:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bffc17c00/0x744cd7666bbba9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba9ae expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.929131:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17c00, rc 0) 00000100:00100000:3.0:1788863584.929284:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323948672:12345-0@lo:101: Request processed in 1232us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.929292:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788863584.929441:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323948672:0@lo:101: 00010000:00010000:3.0:1788863584.929458:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba9b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863584.929468:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba9b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863584.929598:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323948800:0@lo:501: 00000100:00100000:3.0:1788863584.929645:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.929683:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc01540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.929703:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323948800 00000100:00100000:3.0:1788863584.929708:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323948800 00000100:00100000:3.0:1788863584.929738:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788863584.929747:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323948800:12345-0@lo:501: 00000100:00100000:3.0:1788863584.930174:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323948800:12345-0@lo:501: Request processed in 426us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.930250:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788863584.930467:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323948800:0@lo:501: 00000100:00100000:2.0:1788863584.930590:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323948928:0@lo:503: 00000100:00100000:2.0:1788863584.930655:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863584.930688:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf117f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.930699:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323948928 00000100:00100000:3.0:1788863584.930705:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323948928 00000100:00100000:3.0:1788863584.930735:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788863584.930741:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323948928:12345-0@lo:503: 00000100:00100000:3.0:1788863584.930920:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323948928:12345-0@lo:503: Request processed in 179us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.930927:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788863584.931030:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323948928:0@lo:503: 00000100:00100000:2.0:1788863584.932452:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:6704:1875759323949056:0@lo:502: 00000100:00100000:2.0:1788863584.932568:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863584.932725:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323949056 00000100:00100000:3.0:1788863584.932735:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323949056 00000100:00100000:2.0:1788863584.932741:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf117600 going to sleep for 11 seconds 00000100:00100000:3.0:1788863584.932781:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788863584.932791:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:6704:x1875759323949056:12345-0@lo:502: 00000100:00100000:3.0:1788863584.933576:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:6704:x1875759323949056:12345-0@lo:502: Request processed in 782us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863584.933585:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788863584.933663:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:6704:1875759323949056:0@lo:502: 00000020:01000000:3.0:1788863584.933692:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788863584.933700:0:6704:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788863584.933707:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863584.933710:0:6704:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788863584.933715:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788863584.933720:0:6704:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:3.0:1788863584.933744:0:6704:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788863584.933751:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788863584.933772:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e8bff71cd40) 00000020:00000080:3.0:1788863584.933799:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788863584.933806:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788863584.933916:0:6704:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788863584.933922:0:6704:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788863584.933929:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbba9c3 00010000:00080000:3.0:1788863584.934173:0:6704:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8bff2c8800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.151@tcp at head 00000100:00100000:0.0:1788863584.934351:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323948416:12345-0@lo:101: Request processed in 8535us (10406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863584.934359:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:3.0:1788863584.934670:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788863585.069053:0:6704:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788863585.069082:0:6704:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788863585.073671:0:6704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863585.074646:0:6704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863585.075404:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788863585.075501:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788863585.076359:0:6705:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863585.076365:0:6705:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788863585.080429:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788863585.080444:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788863585.080556:0:6704:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788863585.080578:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x744cd7666bbba9ca 00000100:00080000:3.0:1788863585.080589:0:6704:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788863585.080722:0:6704:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8bff2c8800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788863585.080766:0:6704:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bee497800 x1875759323949184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788863585.080874:0:6704:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788863585.080908:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759323949184:0@lo:8: 00000020:01000000:3.0:1788863585.080950:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863585.080957:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863585.080959:0:6704:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788863585.080962:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863585.080968:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863585.080970:0:6704:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788863585.080973:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788863585.080975:0:6704:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788863585.080995:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863585.081003:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee494700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:6704:1875759323949312:0@lo:502: 00000100:00100000:3.0:1788863585.081064:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863585.081093:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bedcc46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863585.081209:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323949184 00000100:00100000:3.0:1788863585.081218:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323949184 00000100:00100000:3.0:1788863585.081254:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863585.081261:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875759323949184:12345-0@lo:8: 00000100:00100000:1.0:1788863585.081297:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759323949440:0@lo:400: 00000100:00100000:3.0:1788863585.081317:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875759323949184:12345-0@lo:8: Request processed in 54us (321us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788863585.081324:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863585.081337:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863585.081350:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323949312 00000100:00100000:3.0:1788863585.081356:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323949312 00000100:00100000:3.0:1788863585.081402:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788863585.081409:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+15:6704:x1875759323949312:12345-0@lo:502: 00000100:00100000:3.0:1788863585.082136:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+15:6704:x1875759323949312:12345-0@lo:502: Request processed in 723us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863585.082146:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788863585.082281:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323949440 00000100:00100000:2.0:1788863585.082288:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323949440 00000100:00100000:3.0:1788863585.082313:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323949568:0@lo:400: 00000100:00100000:2.0:1788863585.082329:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863585.082339:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759323949440:12345-0@lo:400: 00000100:00100000:3.0:1788863585.082350:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863585.082415:0:5840:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788863585.082424:0:5840:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788863585.082740:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788863585.082749:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2c8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788863585.082754:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788863585.082758:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759323949184:0@lo:8: 00000100:00100000:3.0:1788863585.082885:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee494700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:6704:1875759323949312:0@lo:502: 00000020:01000000:3.0:1788863585.082917:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863585.083073:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863585.083077:0:6704:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000100:00100000:2.0:1788863585.083078:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759323949440:12345-0@lo:400: Request processed in 738us (1739us total) trans 0 rc 0/0 00000040:00080000:3.0:1788863585.083085:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1788863585.083088:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863585.083109:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323949568 00000100:00100000:2.0:1788863585.083115:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323949568 00000100:00100000:2.0:1788863585.083150:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788863585.083159:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323949568:12345-0@lo:400: 00000100:00100000:2.0:1788863585.083208:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323949568:12345-0@lo:400: Request processed in 51us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863585.083215:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:3.0:1788863585.083232:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00080000:2.0:1788863585.083241:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1788863585.083255:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788863585.083267:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba9b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.083278:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba9b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863585.083288:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788863585.083290:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8bc84bb380 from 1 10000000:01000000:3.0:1788863585.083293:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788863585.083324:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.083330:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.083338:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863585.083352:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee494700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323949696:0@lo:101: 00000100:00100000:3.0:1788863585.083383:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863585.083407:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bedcc46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863585.083422:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323949696 00000100:00100000:3.0:1788863585.083426:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323949696 00000100:00100000:3.0:1788863585.083450:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788863585.083456:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323949696:12345-0@lo:101: 00010000:00010000:3.0:1788863585.083464:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863585.083551:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbba9d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba9d1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.083584:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbba9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba9d1 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.083594:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbba9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba9d1 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.083661:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17400, rc 0) 00000100:00100000:3.0:1788863585.083693:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323949696:12345-0@lo:101: Request processed in 237us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863585.083700:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1788863585.083755:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8bee495f80 x1875759323949568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863585.083768:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323949568:0@lo:400: 00000100:00100000:3.0:1788863585.083969:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee494700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323949696:0@lo:101: 00010000:00010000:3.0:1788863585.083983:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba9d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.083993:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba9d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863585.084041:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee494700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323949824:0@lo:501: 00000100:00100000:3.0:1788863585.084066:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863585.084089:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bedcc46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863585.084715:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323949824 00000100:00100000:0.0:1788863585.084722:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323949824 00000100:00100000:0.0:1788863585.084763:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788863585.084773:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323949824:12345-0@lo:501: 00010000:00080000:2.0:1788863585.084981:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8bee495500 x1875759323949440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863585.084994:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759323949440:0@lo:400: 00000100:00100000:0.0:1788863585.085007:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323949824:12345-0@lo:501: Request processed in 237us (941us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788863585.085022:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788863585.085041:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee494700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323949824:0@lo:501: 10000000:01000000:3.0:1788863585.085075:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788863585.085088:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba9d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863585.085097:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba9d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788863585.176149:0:6675:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788863585.176157:0:6675:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788863585.176192:0:6675:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788863585.176254:0:6675:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788863585.176280:0:6675:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788863585.176309:0:6675:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788863585.238269:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863586.263751:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863587.286322:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863588.325642:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863589.341610:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863590.358371:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788863590.494371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863590.494381:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788863590.494385:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2c8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863590.494403:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8bff2c8800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788863590.494426:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bfbbda680 x1875759323950336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788863590.494428:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759323950208:0@lo:400: 00000100:00100000:2.0:1788863590.494521:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863590.494590:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863590.494597:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759323950080:0@lo:400: 00000100:00100000:2.0:1788863590.494621:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863590.494661:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323950208 00000100:00100000:2.0:1788863590.494684:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323950208 00000100:00100000:2.0:1788863590.494734:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323950080 00000100:00100000:2.0:1788863590.494737:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323950080 00000100:00100000:2.0:1788863590.494757:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788863590.494765:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759323950208:12345-0@lo:400: 00000100:00100000:2.0:1788863590.494815:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759323950208:12345-0@lo:400: Request processed in 50us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863590.494822:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788863590.494838:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863590.494843:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759323950080:12345-0@lo:400: 00000100:00100000:2.0:1788863590.494891:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759323950080:12345-0@lo:400: Request processed in 47us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863590.494897:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788863590.494913:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788863590.494937:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bfbbdb480 x1875759323950080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863590.494950:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759323950080:0@lo:400: 00010000:00080000:2.0:1788863590.494960:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bfbbdbb80 x1875759323950208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863590.494969:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759323950208:0@lo:400: 00000100:00100000:0.0:1788863590.495726:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323949952:0@lo:400: 00000100:00100000:0.0:1788863590.495781:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863590.495801:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759323950336:0@lo:8: 00000100:00100000:3.0:1788863590.495834:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863590.496067:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323950336 00000100:00100000:0.0:1788863590.496074:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323950336 00000100:00100000:0.0:1788863590.496107:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863590.496113:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875759323950336:12345-0@lo:8: 00010000:00080000:0.0:1788863590.496137:0:6680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:0.0:1788863590.496162:0:6680:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x744cd7666bbba9df 00002000:00100000:0.0:1788863590.496204:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e8beda4a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788863590.496208:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788863590.496213:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788863590.496349:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788863590.496586:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788863590.496612:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8e8beda4e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863590.496665:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875759323950336:12345-0@lo:8: Request processed in 550us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863590.496672:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788863590.496714:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bfbbda680 x1875759323950336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788863600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788863590.496729:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788863590.496737:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788863590.496742:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788863590.496744:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2c8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788863590.496766:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788863590.496777:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759323950336:0@lo:8: 00000004:00080000:3.0:1788863590.497819:0:6705:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788863590.497901:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323949952 00000100:00100000:1.0:1788863590.497910:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323949952 00000100:00100000:1.0:1788863590.497946:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788863590.497954:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:3309:x1875759323949952:12345-0@lo:400: 00000100:00100000:1.0:1788863590.498023:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:3309:x1875759323949952:12345-0@lo:400: Request processed in 69us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863590.498029:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000004:00080000:3.0:1788863590.498578:0:6705:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 219627724794ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788863590.504078:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323949952:0@lo:400: 00000004:00080000:2.0:1788863590.578359:0:6706:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788863590.578394:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6706:1875759323950592:0@lo:7: 00000100:00100000:2.0:1788863590.578477:0:6706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863590.578539:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc7663a80 going to sleep for 11 seconds 00000004:00080000:2.0:1788863590.578557:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788863590.578586:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323950464:0@lo:13: 00000100:00100000:2.0:1788863590.578621:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863590.578671:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323950592 00000100:00100000:2.0:1788863590.578679:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323950592 00000100:00100000:2.0:1788863590.578746:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863590.578755:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6706:x1875759323950592:12345-0@lo:7: 00000100:00100000:0.0:1788863590.578920:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323950464 00000100:00100000:0.0:1788863590.579094:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323950464 00000100:00100000:0.0:1788863590.579292:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863590.579302:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875759323950464:12345-0@lo:13: 00002000:00000024:0.0:1788863590.579334:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788863590.579474:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875759323950464:12345-0@lo:13: Request processed in 174us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863590.579482:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788863590.582000:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788863590.593055:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bee334e00 x1875759323950464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863590.593087:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323950464:0@lo:13: 00002000:00080000:2.0:1788863590.593827:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788863590.593833:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:1.0:1788863590.594461:0:6706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bee335180 x1875759323950592/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788863606 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863590.594488:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6706:1875759323950592:0@lo:7: 00000004:00080000:1.0:1788863590.594500:0:6706:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788863590.594549:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbda300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6706:1875759323950720:0@lo:5: 00000100:00100000:1.0:1788863590.594585:0:6706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863590.594628:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bf47b2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788863590.594668:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6706:x1875759323950592:12345-0@lo:7: Request processed in 15410us (15687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863590.594678:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863590.594703:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323950720 00000100:00100000:2.0:1788863590.594709:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323950720 00000100:00100000:2.0:1788863590.594756:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863590.594764:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6706:x1875759323950720:12345-0@lo:5: 00002000:00080000:2.0:1788863590.594788:0:6679:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788863590.594792:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788863590.595704:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6706:x1875759323950720:12345-0@lo:5: Request processed in 938us (1116us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788863590.595712:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788863590.595761:0:6706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bfbbda300 x1875759323950720/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863606 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863590.595776:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbda300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6706:1875759323950720:0@lo:5: 00000004:00080000:2.0:1788863590.595785:0:6706:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788863590.595816:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee336a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6706:1875759323950848:0@lo:700: 00000100:00100000:2.0:1788863590.595844:0:6706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863590.597092:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc7663e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863590.597124:0:6686:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323950848 00000100:00100000:2.0:1788863590.597136:0:6686:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323950848 00000100:00100000:2.0:1788863590.597248:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863590.597258:0:6686:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6706:x1875759323950848:12345-0@lo:700: 00000100:00100000:2.0:1788863590.597305:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6686:1875759323950976:0@lo:700: 00000100:00100000:2.0:1788863590.597364:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863590.597383:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc7663900 going to sleep for 11 seconds 00000100:00100000:2.0:1788863590.597407:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323950976 00000100:00100000:2.0:1788863590.597411:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323950976 00000100:00100000:2.0:1788863590.597436:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863590.597442:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6686:x1875759323950976:12345-0@lo:700: 40000000:02000000:2.0:1788863590.681910:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788863590.699572:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6686:x1875759323950976:12345-0@lo:700: Request processed in 102121us (102199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863590.699595:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788863590.705191:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bee337b80 x1875759323950976/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788863606 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863590.705210:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6686:1875759323950976:0@lo:700: 40000000:02000000:2.0:1788863590.705227:0:6686:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1788863590.849094:0:6686:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6706:x1875759323950848:12345-0@lo:700: Request processed in 251827us (253239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863590.849114:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:3.0:1788863590.849158:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788863590.849171:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:1.0:1788863590.849604:0:6706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bee336a00 x1875759323950848/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788863606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863590.849625:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee336a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6706:1875759323950848:0@lo:700: 00000004:02000040:0.0:1788863590.896978:0:6706:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788863590.901490:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6706:1875759323951104:0@lo:5: 00000100:00100000:0.0:1788863590.901581:0:6706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863590.901640:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323951104 00000100:00100000:0.0:1788863590.901648:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323951104 00000100:00100000:0.0:1788863590.901697:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863590.901706:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6706:x1875759323951104:12345-0@lo:5: 00000100:00100000:1.0:1788863590.902948:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd2256d80 going to sleep for 11 seconds 00002000:00080000:0.0:1788863590.907475:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788863590.907496:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788863590.911897:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6706:x1875759323951104:12345-0@lo:5: Request processed in 10182us (10308us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788863590.911916:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788863590.911976:0:6706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bc8515500 x1875759323951104/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863590.911990:0:6706:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788863590.912003:0:6706:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e8bc8515500 x1875759323951104/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863606 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863590.912014:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6706:1875759323951104:0@lo:5: 00000004:00080000:2.0:1788863590.912028:0:6706:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788863591.382168:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788863591.875210:0:7049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788863592.406602:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863593.430663:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863594.454448:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863595.478162:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863595.606844:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323951232:0@lo:400: 00000100:00100000:0.0:1788863595.606947:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863595.607004:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863595.607011:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323951616:0@lo:400: 00000100:00100000:0.0:1788863595.607038:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863595.607072:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323951360:0@lo:400: 00000100:00100000:0.0:1788863595.607098:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863595.607133:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863595.607139:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323951488:0@lo:400: 00000100:00100000:0.0:1788863595.607165:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863595.607201:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323951232 00000100:00100000:0.0:1788863595.607210:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323951232 00000100:00100000:0.0:1788863595.607383:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788863595.607392:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:3309:x1875759323951232:12345-0@lo:400: 00000100:00100000:0.0:1788863595.607526:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:3309:x1875759323951232:12345-0@lo:400: Request processed in 135us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863595.607534:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788863595.607568:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323951616 00000100:00100000:0.0:1788863595.607572:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323951616 00000100:00100000:0.0:1788863595.607611:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863595.607618:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875759323951616:12345-0@lo:400: 00000100:00100000:0.0:1788863595.607651:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875759323951616:12345-0@lo:400: Request processed in 34us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863595.607656:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863595.607673:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323951360 00000100:00100000:0.0:1788863595.607677:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323951360 00000100:00100000:0.0:1788863595.607701:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323951488 00000100:00100000:0.0:1788863595.607703:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323951488 00000100:00100000:0.0:1788863595.607724:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863595.607731:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323951360:12345-0@lo:400: 00000100:00100000:0.0:1788863595.607764:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323951360:12345-0@lo:400: Request processed in 33us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863595.607771:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863595.607782:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863595.607788:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323951488:12345-0@lo:400: 00000100:00100000:0.0:1788863595.607823:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323951488:12345-0@lo:400: Request processed in 35us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863595.607829:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788863595.607873:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863595.607923:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788863595.607964:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bc8516300 x1875759323951488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863595.607978:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323951488:0@lo:400: 00010000:00080000:0.0:1788863595.607990:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bc8516680 x1875759323951360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863595.607998:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323951360:0@lo:400: 00010000:00080000:0.0:1788863595.608031:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bc8516a00 x1875759323951616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863595.608040:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323951616:0@lo:400: 00000100:00100000:0.0:1788863595.608049:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323951232:0@lo:400: 00000100:00100000:0.0:1788863595.615369:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323951744:0@lo:13: 00000100:00100000:0.0:1788863595.615493:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863595.615625:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323951744 00000100:00100000:2.0:1788863595.615634:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323951744 00000100:00100000:2.0:1788863595.615707:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863595.615735:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875759323951744:12345-0@lo:13: 00002000:00000024:2.0:1788863595.615787:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863595.615893:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875759323951744:12345-0@lo:13: Request processed in 160us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863595.615901:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788863595.616111:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bee337b80 x1875759323951744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863595.616133:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323951744:0@lo:13: 00000001:00080000:3.0:1788863596.228045:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788863596.502015:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863597.532920:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863598.551304:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863599.582194:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863600.600078:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863600.726405:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323952128:0@lo:400: 00000100:00100000:2.0:1788863600.726476:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863600.726534:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863600.726540:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323952256:0@lo:400: 00000100:00100000:2.0:1788863600.726565:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863600.726598:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323952128 00000100:00100000:1.0:1788863600.726607:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323952128 00000100:00100000:1.0:1788863600.726658:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788863600.726666:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323952128:12345-0@lo:400: 00000100:00100000:1.0:1788863600.726719:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323952128:12345-0@lo:400: Request processed in 54us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863600.726726:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788863600.726748:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323952256 00000100:00100000:1.0:1788863600.726758:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323952256 00000100:00100000:1.0:1788863600.726786:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863600.726792:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323952256:12345-0@lo:400: 00000100:00100000:1.0:1788863600.726824:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323952256:12345-0@lo:400: Request processed in 31us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863600.726830:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788863600.726971:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bee337b80 x1875759323952256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863600.726982:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788863600.726997:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323952256:0@lo:400: 00010000:00080000:1.0:1788863600.727010:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bee337100 x1875759323952128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863600.727019:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323952128:0@lo:400: 00000100:00100000:0.0:1788863600.727827:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323951872:0@lo:400: 00000100:00080000:1.0:1788863600.727906:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863600.727912:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863600.727926:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759323952000:0@lo:400: 00000100:00100000:1.0:1788863600.727960:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863600.728095:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863600.728122:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323952000 00000100:00100000:0.0:1788863600.728129:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323952384:0@lo:13: 00000100:00100000:3.0:1788863600.728137:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323952000 00000100:00100000:0.0:1788863600.728160:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863600.728186:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863600.728197:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759323952000:12345-0@lo:400: 00000100:00100000:0.0:1788863600.728204:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323951872 00000100:00100000:0.0:1788863600.728209:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323951872 00000100:00100000:0.0:1788863600.728241:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788863600.728254:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759323952000:12345-0@lo:400: Request processed in 59us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863600.728259:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+16:3306:x1875759323951872:12345-0@lo:400: 00000100:00100000:3.0:1788863600.728267:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788863600.728337:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+16:3306:x1875759323951872:12345-0@lo:400: Request processed in 82us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863600.728344:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788863600.728374:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323952384 00000100:00100000:0.0:1788863600.728378:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323952384 00000100:00100000:0.0:1788863600.728400:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788863600.728406:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323952384:12345-0@lo:13: 00002000:00000024:0.0:1788863600.728434:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863600.728462:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323952384:12345-0@lo:13: Request processed in 57us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863600.728467:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863600.729212:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323951872:0@lo:400: 00010000:00080000:3.0:1788863600.729234:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bfbbda680 x1875759323952384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863600.729253:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323952384:0@lo:13: 00010000:00080000:0.0:1788863600.729344:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bee335c00 x1875759323952000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863600.729355:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759323952000:0@lo:400: 00010000:00010000:2.0:1788863601.626703:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863602.662009:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863603.670061:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788863604.669305:0:7621:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788863604.669309:0:7621:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788863604.669522:0:7621:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e8bd2b49800 00000020:01000004:3.0:1788863604.669538:0:7621:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788863604.669551:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788863604.669678:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e8bff7199c0) 00000020:00000080:3.0:1788863604.669695:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00010000:00010000:3.0:1788863604.698762:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788863604.699739:0:7621:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788863604.700218:0:7621:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788863604.738943:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788863604.749033:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788863604.749069:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788863604.749145:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788863604.749178:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788863604.749663:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788863604.749683:0:7621:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788863604.749703:0:7621:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x744cd7666bbba9ed 00000020:01000004:2.0:1788863604.749715:0:7621:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788863604.749743:0:7621:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788863604.749747:0:7621:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788863604.749753:0:7621:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788863604.749780:0:7621:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788863604.749792:0:7621:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788863604.827754:0:7621:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788863604.827792:0:7621:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.151@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788863604.827796:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788863604.827798:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788863604.827799:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863604.827801:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863604.827802:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863604.827803:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863604.827805:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863604.827806:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788863604.827807:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788863604.827809:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863604.827811:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788863604.827815:0:7621:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788863604.827817:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788863604.827824:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788863604.827825:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863604.827826:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863604.827826:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863604.827827:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863604.827828:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863604.827829:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788863604.827830:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788863604.827831:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863604.827832:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788863604.827895:0:7621:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788863604.827918:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323952512:0@lo:253: 00000100:00100000:0.0:1788863604.827989:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863604.828045:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863604.828735:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323952512 00000100:00100000:1.0:1788863604.828746:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323952512 00000100:00100000:1.0:1788863604.828804:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788863604.828814:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:7621:x1875759323952512:12345-0@lo:253: 20000000:01000000:1.0:1788863604.828848:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788863604.828885:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788863604.828891:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788863604.828895:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788863604.830058:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863604.830305:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788863604.830319:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788863604.830363:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788863604.830373:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788863604.830406:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788863604.830472:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788863604.830889:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788863604.830910:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:1.0:1788863604.830913:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:1.0:1788863604.830950:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788863604.830959:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788863604.831007:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788863604.831014:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:1.0:1788863604.831060:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788863604.831071:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788863604.831103:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788863604.831154:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788863604.834699:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788863604.834737:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:1.0:1788863604.834740:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:1.0:1788863604.834781:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788863604.834793:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788863604.834825:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788863604.834834:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:1.0:1788863604.835319:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788863604.835332:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788863604.835392:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788863604.835433:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788863604.835456:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788863604.835458:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788863604.835470:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788863604.835485:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788863604.835488:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788863604.835537:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788863604.835540:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788863604.837720:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788863604.837821:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788863604.837930:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788863604.838434:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788863604.838486:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788863604.838551:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788863604.838566:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788863604.838570:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788863604.842658:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788863604.843041:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788863604.843095:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788863604.843193:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788863604.843208:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788863604.843211:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788863604.843939:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788863604.843998:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788863604.844054:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788863604.844494:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788863604.844536:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788863604.844617:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788863604.844632:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788863604.844635:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788863604.850221:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788863604.850377:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788863604.850467:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788863604.853513:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788863604.853586:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788863604.853624:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788863604.853645:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788863604.853648:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788863604.853661:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788863604.853690:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.853718:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbba945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba93e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.853726:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbba96f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba968 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.853731:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba992 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.853754:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bffc17c00/0x744cd7666bbba9b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba9ae expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.853760:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbba9d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba9d1 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.853767:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.853821:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbba9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba9d1 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.853840:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbba9d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba9d1 expref: 16 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863604.854058:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323952640:0@lo:104: 00000100:00100000:1.0:1788863604.854161:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788863604.854216:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bffc17c00/0x744cd7666bbba9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba9ae expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.854225:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bffc17c00/0x744cd7666bbba9b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba9ae expref: 16 pid: 5833 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863604.854246:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323952768:0@lo:104: 00010000:00010000:1.0:1788863604.854275:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba992 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.854284:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba992 expref: 16 pid: 5833 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863604.854307:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323952896:0@lo:104: 00010000:00010000:1.0:1788863604.854335:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbba96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba968 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.854344:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbba96f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba968 expref: 16 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863604.854351:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323953024:0@lo:104: 00010000:00010000:1.0:1788863604.854374:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbba945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba93e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.854383:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbba945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba93e expref: 16 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863604.854391:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323953152:0@lo:104: 00000100:00100000:1.0:1788863604.854408:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863604.854571:0:5823:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788863604.854594:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.854627:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.854636:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.854644:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.854658:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323952640 00000100:00100000:2.0:1788863604.854666:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323952640 00000100:00100000:2.0:1788863604.854714:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323952768 00000100:00100000:2.0:1788863604.854717:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323952768 00000100:00100000:2.0:1788863604.854726:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323952896 00000100:00100000:2.0:1788863604.854728:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323952896 00000100:00100000:2.0:1788863604.854735:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323953024 00000100:00100000:2.0:1788863604.854737:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323953024 00000100:00100000:2.0:1788863604.854744:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323953152 00000100:00100000:2.0:1788863604.854746:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323953152 00000100:00100000:2.0:1788863604.854758:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863604.854767:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc74eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+7:5832:x1875759323952640:12345-0@lo:104: 00010000:00010000:2.0:1788863604.854781:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba9d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.854848:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788863604.854876:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc74eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+7:5832:x1875759323952640:12345-0@lo:104: Request processed in 111us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863604.854884:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863604.854926:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863604.854933:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+6:5832:x1875759323952768:12345-0@lo:104: 00010000:00010000:2.0:1788863604.854941:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba9b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.854976:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788863604.854988:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+6:5832:x1875759323952768:12345-0@lo:104: Request processed in 56us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863604.854994:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863604.855007:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788863604.855013:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+5:5832:x1875759323952896:12345-0@lo:104: 00010000:00010000:2.0:1788863604.855020:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba999 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855047:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788863604.855052:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+5:5832:x1875759323952896:12345-0@lo:104: Request processed in 40us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863604.855057:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788863604.855069:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863604.855074:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+4:5832:x1875759323953024:12345-0@lo:104: 00010000:00010000:2.0:1788863604.855080:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba96f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855102:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788863604.855107:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+4:5832:x1875759323953024:12345-0@lo:104: Request processed in 33us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863604.855111:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863604.855120:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788863604.855125:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:5832:x1875759323953152:12345-0@lo:104: 00010000:00010000:2.0:1788863604.855132:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba945 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855157:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788863604.855168:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:5832:x1875759323953152:12345-0@lo:104: Request processed in 42us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863604.855173:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788863604.855195:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788863604.855203:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba9d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855210:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16c00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:2.0:1788863604.855215:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba9d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855224:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba9d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863604.855244:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba9d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863604.855250:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863604.855291:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba9d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855299:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863604.855320:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba9d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855327:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16c00/0x744cd7666bbba9d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba9d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855342:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788863604.855345:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba9b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855362:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8c021c6800 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:2.0:1788863604.855365:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba9b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855371:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba9b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863604.855376:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba9b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863604.855382:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863604.855397:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba9b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855402:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863604.855416:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba9b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855423:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6800/0x744cd7666bbba9ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba9b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855435:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788863604.855438:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba999 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855444:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc13a0200 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:2.0:1788863604.855447:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba999 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855469:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba999 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863604.855476:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba999 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863604.855481:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863604.855496:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba999 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855502:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863604.855509:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba999 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855517:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0200/0x744cd7666bbba992 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba999 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855528:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863604.855532:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba96f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855537:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8c021c7800 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:2.0:1788863604.855540:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba96f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855547:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba96f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863604.855553:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba96f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863604.855565:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863604.855578:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba96f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855585:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863604.855591:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba96f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855598:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7800/0x744cd7666bbba968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba96f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855613:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863604.855616:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba945 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855621:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8c021c6600 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:2.0:1788863604.855624:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba945 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855630:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba945 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863604.855636:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba945 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863604.855642:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863604.855653:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba945 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855659:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863604.855670:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba945 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855677:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbba93e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba945 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.855693:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863604.855695:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863604.855697:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863604.855724:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323953280:0@lo:103: 00000100:00100000:2.0:1788863604.855774:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.855799:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323953792:0@lo:103: 00000100:00100000:2.0:1788863604.855820:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.855839:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863604.855844:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323953664:0@lo:103: 00000100:00100000:2.0:1788863604.855886:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.855908:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323953536:0@lo:103: 00000100:00100000:2.0:1788863604.855926:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.855935:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863604.855938:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323953408:0@lo:103: 00000100:00100000:2.0:1788863604.855951:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.855968:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323953280 00000100:00100000:2.0:1788863604.855973:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323953280 00010000:00010000:2.0:1788863604.855993:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbba9d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba9d1 expref: 17 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863604.856009:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323953792 00000100:00100000:2.0:1788863604.856012:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323953792 00010000:00010000:2.0:1788863604.856022:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbba945 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba93e expref: 18 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863604.856039:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323953664 00000100:00100000:2.0:1788863604.856041:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323953664 00010000:00010000:2.0:1788863604.856051:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbba96f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba968 expref: 19 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863604.856061:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323953536 00000100:00100000:2.0:1788863604.856063:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323953536 00010000:00010000:2.0:1788863604.856083:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba999 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba992 expref: 20 pid: 5833 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863604.856094:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323953408 00000100:00100000:2.0:1788863604.856096:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323953408 00010000:00010000:2.0:1788863604.856103:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bffc17c00/0x744cd7666bbba9b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba9ae expref: 21 pid: 5833 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863604.856113:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863604.856118:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+21:3307:x1875759323953280:12345-0@lo:103: 00010000:00010000:2.0:1788863604.856128:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863604.856133:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbba9d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba9d1 expref: 21 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856143:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbba9d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba9d1 expref: 21 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856159:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863604.856189:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+21:3307:x1875759323953280:12345-0@lo:103: Request processed in 70us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863604.856196:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863604.856210:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863604.856221:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+20:3307:x1875759323953792:12345-0@lo:103: 00010000:00010000:2.0:1788863604.856229:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863604.856246:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbba945 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba93e expref: 20 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856253:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbba945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba93e expref: 20 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856262:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863604.856283:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+20:3307:x1875759323953792:12345-0@lo:103: Request processed in 63us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863604.856290:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863604.856302:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788863604.856308:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759323953664:12345-0@lo:103: 00010000:00010000:2.0:1788863604.856316:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863604.856321:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbba96f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba968 expref: 19 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856328:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbba96f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba968 expref: 19 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856337:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863604.856356:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759323953664:12345-0@lo:103: Request processed in 48us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863604.856362:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788863604.856374:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863604.856380:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+18:3309:x1875759323953536:12345-0@lo:103: 00010000:00010000:2.0:1788863604.856388:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863604.856399:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba999 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba992 expref: 18 pid: 5833 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856408:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba992 expref: 18 pid: 5833 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856417:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863604.856443:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+18:3309:x1875759323953536:12345-0@lo:103: Request processed in 63us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863604.856449:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863604.856461:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788863604.856467:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+17:3309:x1875759323953408:12345-0@lo:103: 00010000:00010000:2.0:1788863604.856490:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863604.856496:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bffc17c00/0x744cd7666bbba9b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba9ae expref: 17 pid: 5833 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856505:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bffc17c00/0x744cd7666bbba9b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba9ae expref: 17 pid: 5833 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856518:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856527:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856546:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856554:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856561:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856575:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856582:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc13a1400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863604.856587:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856596:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856606:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.856618:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863604.856645:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+17:3309:x1875759323953408:12345-0@lo:103: Request processed in 178us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863604.856651:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788863604.856695:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323953408:0@lo:103: 00000100:00100000:2.0:1788863604.856703:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323953536:0@lo:103: 00000100:00100000:2.0:1788863604.856732:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323953664:0@lo:103: 00000100:00100000:2.0:1788863604.856739:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323953280:0@lo:103: 00000100:00100000:2.0:1788863604.856745:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323953792:0@lo:103: 00010000:00010000:2.0:1788863604.856785:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863604.857109:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbba9d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba9d1 expref: 16 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863604.857297:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323952640:0@lo:104: 00010000:00010000:1.0:1788863604.857314:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bffc17c00/0x744cd7666bbba9b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba9ae expref: 15 pid: 5833 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863604.857321:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323952768:0@lo:104: 00010000:00010000:1.0:1788863604.857331:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbba999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba992 expref: 14 pid: 5833 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863604.857356:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323952896:0@lo:104: 00010000:00010000:1.0:1788863604.857371:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbba96f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba968 expref: 13 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863604.857380:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323953024:0@lo:104: 00010000:00010000:1.0:1788863604.857389:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbba945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba93e expref: 12 pid: 5835 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863604.857401:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875759323953152:0@lo:104: 00010000:00010000:1.0:1788863604.857425:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.857435:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.857441:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.857447:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbba9f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788863604.857463:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788863604.961721:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+11:7621:x1875759323952512:12345-0@lo:253: Request processed in 132898us (133721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863604.961736:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788863604.961914:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323952512:0@lo:253: 10000000:01000000:2.0:1788863604.961930:0:7621:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788863604.961949:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788863604.961951:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788863604.961953:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863604.961954:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788863604.961956:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863604.961957:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863604.961958:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788863604.961960:0:7621:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788863604.961962:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863604.961963:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788863604.961984:0:7621:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8bd2b49800 from lustre-OST0001 10000000:01000000:2.0:1788863604.962011:0:7621:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788863604.962014:0:7621:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788863604.962023:0:7621:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e8bc84bb380 local copy 10000000:01000000:2.0:1788863604.962027:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788863604.962069:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.962081:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.962091:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863604.962109:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323953920:0@lo:101: 00000100:00100000:2.0:1788863604.962159:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.962211:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe246c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863604.962461:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323953920 00000100:00100000:1.0:1788863604.962468:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323953920 00000100:00100000:1.0:1788863604.962523:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788863604.962540:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+11:7621:x1875759323953920:12345-0@lo:101: 00010000:00010000:1.0:1788863604.962555:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863604.962571:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaa02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbba9fb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.962610:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaa02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbba9fb expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.962621:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaa02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba9fb expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863604.962631:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc13a1400, rc 0) 00000100:00100000:1.0:1788863604.962672:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:7621:x1875759323953920:12345-0@lo:101: Request processed in 133us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863604.962678:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788863604.962804:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323953920:0@lo:101: 00010000:00010000:2.0:1788863604.962817:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x744cd7666bbbaa02 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.962827:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x744cd7666bbbaa02 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863604.962986:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954048:0@lo:501: 00000100:00100000:2.0:1788863604.963014:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.963033:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863604.963093:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323954048 00000100:00100000:3.0:1788863604.963099:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323954048 00000100:00100000:3.0:1788863604.963149:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788863604.963158:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:7621:x1875759323954048:12345-0@lo:501: 00000100:00100000:3.0:1788863604.963432:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:7621:x1875759323954048:12345-0@lo:501: Request processed in 275us (416us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788863604.963441:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788863604.963540:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954048:0@lo:501: 10000000:01000000:2.0:1788863604.963553:0:7621:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788863604.963597:0:7621:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788863604.963604:0:7621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x744cd7666bbbaa02 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.963613:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x744cd7666bbbaa02 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.963620:0:7621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x744cd7666bbbaa02 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.963647:0:7621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788863604.963668:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8bd2b49800 10000000:01000000:2.0:1788863604.963673:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788863604.963680:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788863604.963683:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788863604.963687:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788863604.963691:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788863604.963713:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.963720:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.963742:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863604.963756:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954176:0@lo:101: 00000100:00100000:2.0:1788863604.963784:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.963796:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24d80 going to sleep for 11 seconds 00010000:00010000:3.0:1788863604.965626:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863604.965641:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x744cd7666bbbaa02 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863604.965652:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166a800 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863604.965656:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x744cd7666bbbaa02 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863604.965666:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x744cd7666bbbaa02 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863604.965672:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x744cd7666bbbaa02 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863604.965679:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788863604.965715:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x744cd7666bbbaa02 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863604.965721:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863604.965753:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x744cd7666bbbaa02 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863604.965761:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbba9fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x744cd7666bbbaa02 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863604.965777:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863604.965779:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863604.965791:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863604.965811:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323954176 00000100:00100000:3.0:1788863604.965818:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323954176 00000100:00100000:3.0:1788863604.965899:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788863604.965909:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:7621:x1875759323954176:12345-0@lo:101: 00010000:00010000:3.0:1788863604.965922:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863604.965938:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bffc17800/0x744cd7666bbbaa10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbaa09 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863604.965959:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc17800/0x744cd7666bbbaa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbaa09 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863604.965969:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bffc17800/0x744cd7666bbbaa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa09 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863604.965978:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17800, rc 0) 00000100:00100000:3.0:1788863604.966041:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323954176:12345-0@lo:101: Request processed in 134us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863604.966047:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788863604.966260:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323954304:0@lo:103: 00000100:00100000:2.0:1788863604.966294:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.966386:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954176:0@lo:101: 00010000:00010000:2.0:1788863604.966400:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa10 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863604.966408:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbaa10 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863604.966511:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954432:0@lo:501: 00000100:00100000:2.0:1788863604.966535:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.966556:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863604.966657:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323954432 00000100:00100000:1.0:1788863604.966663:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323954432 00000100:00100000:1.0:1788863604.966698:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788863604.966705:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323954432:12345-0@lo:501: 00000100:00100000:1.0:1788863604.966953:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323954432:12345-0@lo:501: Request processed in 248us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863604.966960:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788863604.967047:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323954304 00000100:00100000:3.0:1788863604.967051:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323954304 00000100:00100000:3.0:1788863604.967080:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863604.967087:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+13:3308:x1875759323954304:12345-0@lo:103: 00010000:00010000:3.0:1788863604.967095:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863604.967107:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaa02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbba9fb expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863604.967119:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863604.967144:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+12:3308:x1875759323954304:12345-0@lo:103: Request processed in 59us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863604.967157:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863604.967337:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323954304:0@lo:103: 00000100:00100000:2.0:1788863604.967368:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954432:0@lo:501: 00000100:00100000:2.0:1788863604.967400:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954560:0@lo:503: 00000100:00100000:2.0:1788863604.967438:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.967471:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863604.967522:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323954560 00000100:00100000:3.0:1788863604.967527:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323954560 00000100:00100000:3.0:1788863604.967555:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788863604.967561:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:7621:x1875759323954560:12345-0@lo:503: 00000100:00100000:3.0:1788863604.967819:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+12:7621:x1875759323954560:12345-0@lo:503: Request processed in 257us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863604.967825:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788863604.967940:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954560:0@lo:503: 00000040:00080000:2.0:1788863604.968248:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788863604.968324:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954688:0@lo:502: 00000100:00100000:2.0:1788863604.968362:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.968440:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863604.971095:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323954688 00000100:00100000:1.0:1788863604.971124:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323954688 00000100:00100000:1.0:1788863604.971253:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788863604.971265:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:7621:x1875759323954688:12345-0@lo:502: 00000100:00100000:1.0:1788863604.972166:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+12:7621:x1875759323954688:12345-0@lo:502: Request processed in 900us (3800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863604.972188:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788863604.972315:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954688:0@lo:502: 00000040:00080000:2.0:1788863604.972724:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788863604.972801:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788863604.972838:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788863604.972954:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788863604.973000:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788863604.973039:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788863604.973081:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954816:0@lo:502: 00000100:00100000:2.0:1788863604.973153:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863604.978265:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863604.978474:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323954816 00000100:00100000:3.0:1788863604.978486:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323954816 00000100:00100000:3.0:1788863604.978537:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788863604.978546:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:7621:x1875759323954816:12345-0@lo:502: 00000100:00100000:3.0:1788863604.979505:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:7621:x1875759323954816:12345-0@lo:502: Request processed in 951us (6344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863604.979517:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788863604.980089:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954816:0@lo:502: 00000040:00080000:2.0:1788863604.980359:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788863604.980376:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788863604.981291:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788863604.981300:0:7628:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788863604.981306:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863604.981309:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788863604.981314:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788863604.981330:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e8bee48b380) 00000020:00000080:1.0:1788863604.981354:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788863604.981361:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788863604.981427:0:7628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8bd2b49800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788863604.981437:0:7628:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788863604.981445:0:7628:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x744cd7666bbbaa1e 00010000:00010000:2.0:1788863604.988478:0:7628:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788863604.989258:0:7628:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788863604.995286:0:7628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788863604.995627:0:7628:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788863605.000511:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788863605.001801:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788863605.010669:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788863605.010688:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863605.010697:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863605.010700:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788863605.010705:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863605.010709:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863605.010710:0:7628:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788863605.010713:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788863605.010715:0:7628:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788863605.010804:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863605.010808:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863605.010835:0:7628:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788863605.010839:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788863605.011285:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788863605.011310:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788863605.011336:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa10 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.011351:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa10 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863605.011373:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bd2b49800 from 1 10000000:01000000:2.0:1788863605.011376:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788863605.011418:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.011427:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.011440:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863605.011475:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954944:0@lo:101: 00000100:00100000:2.0:1788863605.011588:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.011631:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788863605.011742:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323954944 00000100:00100000:1.0:1788863605.011750:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323954944 00000100:00100000:1.0:1788863605.011798:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788863605.011807:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:7621:x1875759323954944:12345-0@lo:101: 00010000:00010000:1.0:1788863605.011820:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863605.011833:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbbaa2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbaa25 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863605.011883:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbbaa2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbaa25 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863605.011893:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbbaa2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa25 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863605.011900:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc13a0a00, rc 0) 00000100:00100000:1.0:1788863605.011937:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323954944:12345-0@lo:101: Request processed in 132us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863605.011945:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788863605.012078:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323954944:0@lo:101: 00010000:00010000:2.0:1788863605.012095:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa2c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.012105:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbaa2c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863605.012353:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955072:0@lo:501: 00000100:00100000:2.0:1788863605.012382:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.012413:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788863605.012469:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323955072 00000100:00100000:1.0:1788863605.012475:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323955072 00000100:00100000:1.0:1788863605.012511:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788863605.012518:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323955072:12345-0@lo:501: 00000100:00100000:1.0:1788863605.012797:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323955072:12345-0@lo:501: Request processed in 278us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863605.012804:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788863605.013142:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955072:0@lo:501: 00000100:00100000:2.0:1788863605.013184:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955200:0@lo:503: 00000100:00100000:2.0:1788863605.013246:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.013275:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863605.013559:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323955200 00000100:00100000:3.0:1788863605.013566:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323955200 00000100:00100000:3.0:1788863605.013613:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788863605.013621:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323955200:12345-0@lo:503: 00000100:00100000:3.0:1788863605.013986:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323955200:12345-0@lo:503: Request processed in 365us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863605.013993:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788863605.016990:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955200:0@lo:503: 00000040:00080000:2.0:1788863605.018038:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788863605.018140:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955328:0@lo:502: 00000100:00100000:2.0:1788863605.018216:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.018921:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863605.026157:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323955328 00000100:00100000:3.0:1788863605.026179:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323955328 00000100:00100000:3.0:1788863605.026260:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788863605.026272:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323955328:12345-0@lo:502: 00000100:00100000:3.0:1788863605.026822:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323955328:12345-0@lo:502: Request processed in 552us (8605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863605.026832:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788863605.028179:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955328:0@lo:502: 00000040:00080000:3.0:1788863605.028833:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788863605.029061:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788863605.029707:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955456:0@lo:502: 00000100:00100000:3.0:1788863605.029831:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863605.029927:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd2849b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863605.030396:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323955456 00000100:00100000:1.0:1788863605.030410:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323955456 00000100:00100000:1.0:1788863605.030484:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788863605.030496:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323955456:12345-0@lo:502: 00000100:00100000:1.0:1788863605.030795:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323955456:12345-0@lo:502: Request processed in 301us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863605.030804:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788863605.033201:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955456:0@lo:502: 00000040:00080000:3.0:1788863605.033511:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788863605.033533:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788863605.035482:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863605.035496:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863605.035499:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788863605.035514:0:7632:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8bd2b49800 00000020:00000080:3.0:1788863605.035517:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788863605.035555:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863605.035559:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863605.035561:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788863605.035564:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788863605.035803:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788863605.035830:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788863605.035884:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa2c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.035897:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa2c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863605.035941:0:7621:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788863605.035954:0:7621:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8bd2b49800 10000000:01000000:2.0:1788863605.035958:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8bd2b49800 10000000:01000000:2.0:1788863605.035962:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788863605.035969:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e8bd2b49800 from 1 10000000:01000000:2.0:1788863605.035971:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788863605.036007:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.036016:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.036026:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863605.036062:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955584:0@lo:101: 00000100:00100000:2.0:1788863605.036145:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.036192:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863605.036498:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323955584 00000100:00100000:0.0:1788863605.036510:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323955584 00000100:00100000:0.0:1788863605.036589:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788863605.036599:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323955584:12345-0@lo:101: 00010000:00010000:0.0:1788863605.036615:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863605.036631:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0030400/0x744cd7666bbbaa3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbaa33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863605.036661:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0030400/0x744cd7666bbbaa3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbaa33 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863605.036673:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0030400/0x744cd7666bbbaa3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa33 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863605.036683:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030400, rc 0) 00000100:00100000:0.0:1788863605.036748:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+14:7621:x1875759323955584:12345-0@lo:101: Request processed in 151us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863605.036756:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788863605.036809:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955584:0@lo:101: 00010000:00010000:0.0:1788863605.036825:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa3a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863605.036833:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbaa3a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863605.038427:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955712:0@lo:501: 00000100:00100000:0.0:1788863605.038507:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.039018:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323955712 00000100:00100000:2.0:1788863605.039030:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323955712 00000100:00100000:2.0:1788863605.039094:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788863605.039105:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+14:7621:x1875759323955712:12345-0@lo:501: 00000100:00100000:2.0:1788863605.039547:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+14:7621:x1875759323955712:12345-0@lo:501: Request processed in 442us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863605.039555:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788863605.040138:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788863605.040171:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955712:0@lo:501: 00000100:00100000:0.0:1788863605.040239:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955840:0@lo:503: 00000100:00100000:0.0:1788863605.040305:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863605.040321:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788863605.040383:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323955840 00000100:00100000:2.0:1788863605.040391:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323955840 00000100:00100000:2.0:1788863605.040475:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788863605.040485:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+14:7621:x1875759323955840:12345-0@lo:503: 00000100:00100000:2.0:1788863605.040718:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+14:7621:x1875759323955840:12345-0@lo:503: Request processed in 234us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863605.040726:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788863605.040794:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955840:0@lo:503: 00000040:00080000:0.0:1788863605.041157:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788863605.041238:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955968:0@lo:502: 00000100:00100000:0.0:1788863605.041283:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863605.043420:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788863605.043512:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323955968 00000100:00100000:3.0:1788863605.043525:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323955968 00000100:00100000:3.0:1788863605.043772:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788863605.043782:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+14:7621:x1875759323955968:12345-0@lo:502: 00000100:00100000:3.0:1788863605.044467:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+14:7621:x1875759323955968:12345-0@lo:502: Request processed in 683us (3179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863605.044475:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788863605.045224:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323955968:0@lo:502: 00000040:00080000:1.0:1788863605.045762:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788863605.045829:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788863605.046250:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788863605.046310:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788863605.046349:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788863605.046405:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788863605.046445:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788863605.046479:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788863605.046528:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788863605.046750:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788863605.046791:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788863605.046845:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788863605.047080:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788863605.047113:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788863605.047163:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788863605.047200:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788863605.047311:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788863605.047379:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788863605.047422:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788863605.047458:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788863605.047509:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788863605.047795:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788863605.047831:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788863605.048356:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788863605.048399:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788863605.048454:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788863605.048504:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788863605.048681:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788863605.048718:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788863605.048767:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788863605.048799:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788863605.048829:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788863605.049034:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788863605.049092:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788863605.049131:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788863605.049181:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788863605.049218:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788863605.049306:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323956096:0@lo:502: 00000100:00100000:1.0:1788863605.049444:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863605.049740:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863605.049793:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323956096 00000100:00100000:2.0:1788863605.049804:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323956096 00000100:00100000:2.0:1788863605.050110:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788863605.050214:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+14:7621:x1875759323956096:12345-0@lo:502: 00000100:00100000:2.0:1788863605.051131:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+14:7621:x1875759323956096:12345-0@lo:502: Request processed in 916us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863605.051142:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788863605.051367:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323956096:0@lo:502: 00000040:00080000:1.0:1788863605.051710:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788863605.051727:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788863605.053356:0:7633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788863605.053375:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e8bff71b380) 00000020:00000080:3.0:1788863605.053405:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788863605.053488:0:7633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8bd2b49800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788863605.053493:0:7633:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8bd2b49800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788863605.053496:0:7633:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8bd2b49800 3 00010000:00080000:3.0:1788863605.053712:0:7633:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8bff2ce800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1788863605.056473:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788863605.056840:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788863605.056926:0:7633:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788863605.057190:0:7633:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x744cd7666bbbaa48 00000100:00080000:3.0:1788863605.057201:0:7633:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788863605.057215:0:7633:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e8bff2ce800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788863605.057270:0:7633:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bee497800 x1875759323956224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863605.057340:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875759323956224:0@lo:38: 00000100:00100000:0.0:1788863605.057417:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.057521:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323956224 00000100:00100000:2.0:1788863605.057529:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323956224 00000100:00100000:2.0:1788863605.057592:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863605.057600:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1875759323956224:12345-0@lo:38: 00010000:00080000:2.0:1788863605.057622:0:5841:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:2.0:1788863605.057652:0:5841:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x744cd7666bbbaa4f 00000004:00100000:2.0:1788863605.057666:0:5841:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788863605.057699:0:5841:0:(import.c:65:import_set_state_nolock()) ffff8e8bf4f1e000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788863605.059506:0:7633:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788863605.060236:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323956352:0@lo:400: 00000100:00100000:3.0:1788863605.060312:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.060839:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875759323956224:12345-0@lo:38: Request processed in 3235us (3418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863605.060875:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863605.060901:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323956352 00000100:00100000:2.0:1788863605.060908:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323956352 00000100:00100000:2.0:1788863605.060964:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863605.060972:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323956352:12345-0@lo:400: 00010000:00080000:0.0:1788863605.061216:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bee497800 x1875759323956224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863605.061238:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788863605.061248:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788863605.061256:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788863605.061261:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788863605.061264:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788863605.061272:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875759323956224:0@lo:38: 00000100:00100000:2.0:1788863605.062918:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323956352:12345-0@lo:400: Request processed in 1936us (2595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863605.062932:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863605.063479:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323956480:0@lo:400: 00000100:00100000:2.0:1788863605.063566:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.063733:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863605.063742:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323956608:0@lo:400: 00000100:00100000:2.0:1788863605.063773:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.063819:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323956608 00000100:00100000:2.0:1788863605.063829:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323956608 00000100:00100000:2.0:1788863605.063918:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863605.063928:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323956608:12345-0@lo:400: 00000100:00100000:2.0:1788863605.064728:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323956608:12345-0@lo:400: Request processed in 797us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863605.064748:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788863605.064785:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788863605.064831:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bfbbd8e00 x1875759323956608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863605.064881:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323956608:0@lo:400: 00000100:00100000:1.0:1788863605.065169:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323956480 00000100:00100000:1.0:1788863605.065178:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323956480 00000100:00100000:1.0:1788863605.065241:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863605.065252:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323956480:12345-0@lo:400: 00000100:00100000:1.0:1788863605.065318:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323956480:12345-0@lo:400: Request processed in 69us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863605.065325:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788863605.065404:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788863605.065428:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bfbbd8380 x1875759323956480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863605.065439:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323956480:0@lo:400: 00010000:00080000:3.0:1788863605.068144:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bfbbdad80 x1875759323956352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863605.068163:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323956352:0@lo:400: 00000040:00080000:3.0:1788863605.071045:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1788863605.071316:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516d80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7635:1875759323956736:0@lo:901: 00000100:00100000:0.0:1788863605.071397:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863605.071435:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863605.071745:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323956736 00000100:00100000:3.0:1788863605.071753:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323956736 00000100:00100000:3.0:1788863605.071824:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863605.071836:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7635:x1875759323956736:12345-0@lo:901: 00000100:00100000:3.0:1788863605.072392:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7635:x1875759323956736:12345-0@lo:901: Request processed in 557us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863605.072401:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788863605.072501:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788863605.072738:0:7635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bc8516d80 x1875759323956736/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788863621 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863605.072754:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516d80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7635:1875759323956736:0@lo:901: 00000020:01000000:2.0:1788863605.074402:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788863605.074439:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863605.074460:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa3a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.074474:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa3a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788863605.074528:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788863605.075238:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788863605.075239:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863605.075241:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863605.075242:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863605.075244:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863605.075246:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788863605.075247:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788863605.075249:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788863605.075250:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863605.075252:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788863605.075256:0:7621:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788863605.075266:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788863605.075267:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788863605.075268:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863605.075269:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863605.075269:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863605.075271:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863605.075272:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788863605.075273:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788863605.075274:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788863605.075275:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863605.075276:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788863605.075307:0:7621:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788863605.075328:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323956864:0@lo:253: 00000100:00100000:2.0:1788863605.075401:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.075441:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24540 going to sleep for 11 seconds 00000100:00100000:1.0:1788863605.075759:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323956864 00000100:00100000:1.0:1788863605.075767:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323956864 00000100:00100000:1.0:1788863605.075812:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788863605.075820:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+14:7621:x1875759323956864:12345-0@lo:253: 20000000:01000000:1.0:1788863605.075845:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788863605.075890:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788863605.128665:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788863605.128688:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788863605.128750:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788863605.128755:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788863605.128779:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863605.128799:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbba9a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba9a0 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863605.128807:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863605.128895:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbba9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba9a0 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863605.128913:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbba9a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba9a0 expref: 14 pid: 5835 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863605.128952:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee496680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875759323956992:0@lo:104: 00000100:00100000:3.0:1788863605.129035:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863605.129086:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd2849780 going to sleep for 11 seconds 00000100:00100000:2.0:1788863605.129160:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323956992 00000100:00100000:2.0:1788863605.129177:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323956992 00000100:00100000:1.0:1788863605.129347:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788863605.129362:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:5856:x1875759323956992:12345-0@lo:104: 00010000:00010000:1.0:1788863605.129382:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863605.129455:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863605.129461:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:5856:x1875759323956992:12345-0@lo:104: Request processed in 103us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863605.129468:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863605.129482:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee496680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875759323956992:0@lo:104: 00010000:00010000:1.0:1788863605.129493:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863605.129500:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.129507:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863605.129508:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8c021c6200 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:1.0:1788863605.129513:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863605.129523:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863605.129539:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863605.129546:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863605.129590:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863605.129598:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863605.129621:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863605.129629:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbba9a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba9a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863605.129650:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863605.129652:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863605.129653:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863605.129667:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323957120:0@lo:103: 00000100:00100000:1.0:1788863605.129701:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.129725:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323957120 00000100:00100000:2.0:1788863605.129730:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323957120 00010000:00010000:2.0:1788863605.129749:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbba9a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba9a0 expref: 15 pid: 5835 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863605.129786:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863605.129794:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2886850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+15:3308:x1875759323957120:12345-0@lo:103: 00010000:00010000:2.0:1788863605.129806:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863605.129812:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbba9a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba9a0 expref: 15 pid: 5835 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.129825:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbba9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba9a0 expref: 15 pid: 5835 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.129849:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbba9a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba9a0 expref: 15 pid: 5835 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.129888:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.129896:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788863605.129911:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005196512s 00010000:00010000:2.0:1788863605.129916:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.129923:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.129931:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.129939:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.129954:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17a00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863605.129958:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.129966:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.129980:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.129998:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863605.130031:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2886850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+14:3308:x1875759323957120:12345-0@lo:103: Request processed in 239us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863605.130038:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863605.130094:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323957120:0@lo:103: 00010000:00010000:2.0:1788863605.130110:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.130135:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863605.130141:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbaa56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863605.142066:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:7621:x1875759323956864:12345-0@lo:253: Request processed in 66235us (66654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863605.142084:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788863605.142923:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eff03fbe-e653-4192-b926-0416f2048378:7621:1875759323956864:0@lo:253: 10000000:01000000:2.0:1788863605.142954:0:7621:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788863605.142959:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788863605.142961:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788863605.142963:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788863605.142964:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788863605.142966:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788863605.142967:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788863605.142968:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788863605.142970:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788863605.142971:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788863605.142973:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788863605.142974:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788863605.142994:0:7621:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788863605.151846:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788863605.152729:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788863605.152990:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788863605.155327:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788863605.155622:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788863605.155947:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788863605.162324:0:7621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788863605.380970:0:7621:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788863605.380979:0:7621:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788863605.381022:0:7621:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788863605.381093:0:7621:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788863605.381112:0:7621:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788863605.381136:0:7621:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788863605.719258:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863605.855896:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863605.856032:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323957248:0@lo:13: 00000100:00100000:3.0:1788863605.856113:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863605.856249:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323957248 00000100:00100000:2.0:1788863605.856258:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323957248 00000100:00100000:2.0:1788863605.856318:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788863605.856344:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323957248:12345-0@lo:13: 00002000:00000024:2.0:1788863605.856387:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863605.856438:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323957248:12345-0@lo:13: Request processed in 95us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863605.856444:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788863605.856484:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee496a00 x1875759323957248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863605.856507:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323957248:0@lo:13: 00010000:00010000:1.0:1788863606.743005:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863607.770293:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863608.796055:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863609.823319:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863610.455542:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323957376:0@lo:400: 00000100:00100000:3.0:1788863610.455649:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863610.455702:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323957888:0@lo:400: 00000100:00100000:3.0:1788863610.455739:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863610.455768:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863610.455774:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323957504:0@lo:400: 00000100:00100000:3.0:1788863610.455794:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863610.455922:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323957760:0@lo:400: 00000100:00100000:3.0:1788863610.455977:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863610.456004:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863610.456010:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759323957632:0@lo:400: 00000100:00100000:2.0:1788863610.456220:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323957376 00000100:00100000:2.0:1788863610.456231:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323957376 00000100:00100000:2.0:1788863610.456291:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788863610.456301:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:3306:x1875759323957376:12345-0@lo:400: 00000100:00100000:1.0:1788863610.456551:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323957888 00000100:00100000:1.0:1788863610.456556:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323957888 00000100:00100000:1.0:1788863610.456596:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323957504 00000100:00100000:1.0:1788863610.456599:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323957504 00000100:00100000:1.0:1788863610.456619:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788863610.456627:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323957888:12345-0@lo:400: 00000100:00100000:1.0:1788863610.456670:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323957888:12345-0@lo:400: Request processed in 45us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863610.456689:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788863610.456710:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788863610.456715:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323957504:12345-0@lo:400: 00000100:00100000:1.0:1788863610.456746:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323957504:12345-0@lo:400: Request processed in 31us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863610.456751:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788863610.457822:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863610.457903:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323957760 00000100:00100000:3.0:1788863610.457911:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323957760 00000100:00100000:3.0:1788863610.457964:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788863610.457974:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323957760:12345-0@lo:400: 00000100:00100000:2.0:1788863610.458475:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:3306:x1875759323957376:12345-0@lo:400: Request processed in 71us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863610.458491:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788863610.458804:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323957632 00000100:00100000:1.0:1788863610.458812:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323957632 00000100:00100000:1.0:1788863610.458873:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788863610.458883:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759323957632:12345-0@lo:400: 00000100:00080000:2.0:1788863610.465099:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863610.465116:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788863610.465213:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bf4c58380 x1875759323957504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863610.465237:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323957504:0@lo:400: 00000100:00100000:2.0:1788863610.465252:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323957376:0@lo:400: 00010000:00080000:2.0:1788863610.465274:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bf4c58700 x1875759323957888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863610.465282:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323957888:0@lo:400: 00000100:00100000:3.0:1788863610.471624:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323957760:12345-0@lo:400: Request processed in 13636us (15630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863610.471649:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788863610.471910:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bf4c59c00 x1875759323957760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863610.471951:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323957760:0@lo:400: 00000100:00100000:1.0:1788863610.473403:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759323957632:12345-0@lo:400: Request processed in 14508us (15574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863610.473420:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788863610.483800:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bf4c5b100 x1875759323957632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863610.483832:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759323957632:0@lo:400: 00010000:00010000:2.0:1788863610.843821:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863610.970134:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863610.970161:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323958016:0@lo:13: 00000100:00100000:2.0:1788863610.970236:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863610.970334:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323958016 00000100:00100000:0.0:1788863610.970345:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323958016 00000100:00100000:0.0:1788863610.970408:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863610.970418:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323958016:12345-0@lo:13: 00002000:00000024:0.0:1788863610.970468:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863610.970527:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323958016:12345-0@lo:13: Request processed in 110us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863610.970548:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788863610.970619:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bc8516d80 x1875759323958016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863610.970640:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323958016:0@lo:13: 00010000:00010000:0.0:1788863611.862027:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863612.901529:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788863613.205787:0:7976:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788863613.910051:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788863614.037986:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788863614.037998:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e8bde7ad800 from 30 10000000:01000000:2.0:1788863614.038003:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788863614.038045:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863614.038070:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863614.038082:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863614.038184:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323958144:0@lo:101: 00000100:00100000:2.0:1788863614.038269:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863614.038371:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.039705:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323958144 00000100:00100000:0.0:1788863614.039719:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323958144 00000100:00100000:0.0:1788863614.040040:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788863614.040064:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323958144:12345-0@lo:101: 00010000:00010000:0.0:1788863614.040083:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863614.040104:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbbaa64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbaa5d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.040139:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbbaa64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbaa5d expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.040151:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbbaa64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa5d expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.040160:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031400, rc 0) 00000100:00100000:0.0:1788863614.040223:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+14:5838:x1875759323958144:12345-0@lo:101: Request processed in 174us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863614.043827:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323958144:0@lo:101: 00010000:00010000:2.0:1788863614.043886:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa64 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863614.043902:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbaa64 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863614.043983:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323958272:0@lo:501: 00000100:00100000:2.0:1788863614.044042:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863614.044230:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863614.044353:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323958272 00000100:00100000:3.0:1788863614.044372:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323958272 00000100:00100000:3.0:1788863614.044422:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788863614.044431:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323958272:12345-0@lo:501: 00000100:00100000:3.0:1788863614.045343:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323958272:12345-0@lo:501: Request processed in 908us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863614.045353:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788863614.046399:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788863614.047295:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323958272:0@lo:501: 00000100:00100000:3.0:1788863614.052273:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323958400:0@lo:503: 00000100:00100000:3.0:1788863614.052443:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863614.052499:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bf4a160c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.052516:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323958400 00000100:00100000:0.0:1788863614.052526:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323958400 00000100:00100000:0.0:1788863614.052589:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788863614.052600:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+14:5838:x1875759323958400:12345-0@lo:503: 00000100:00100000:3.0:1788863614.053215:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+14:5838:x1875759323958400:12345-0@lo:503: Request processed in 615us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863614.053225:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788863614.053549:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323958400:0@lo:503: 00000100:00100000:1.0:1788863614.054665:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8019:1875759323958528:0@lo:502: 00000100:00100000:1.0:1788863614.054740:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863614.054837:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.055008:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323958528 00000100:00100000:0.0:1788863614.055016:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323958528 00000100:00100000:1.0:1788863614.055208:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788863614.055221:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+14:8019:x1875759323958528:12345-0@lo:502: 00000100:00100000:1.0:1788863614.055589:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+14:8019:x1875759323958528:12345-0@lo:502: Request processed in 370us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863614.055598:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788863614.055699:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8019:1875759323958528:0@lo:502: 00000100:00100000:0.0:1788863614.055782:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8019:1875759323958656:0@lo:502: 00000100:00100000:0.0:1788863614.055824:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863614.056596:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323958656 00000100:00100000:2.0:1788863614.056606:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323958656 00000100:00100000:2.0:1788863614.056651:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788863614.056658:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+14:8019:x1875759323958656:12345-0@lo:502: 00000100:00100000:2.0:1788863614.056928:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+14:8019:x1875759323958656:12345-0@lo:502: Request processed in 269us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863614.056936:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788863614.057913:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863614.057947:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8019:1875759323958656:0@lo:502: 00000040:00080000:1.0:1788863614.057988:0:8019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788863614.058110:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788863614.058130:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863614.058143:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa64 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863614.058155:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa64 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863614.058183:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788863614.058186:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788863614.058189:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788863614.058232:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863614.058240:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863614.058250:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863614.058269:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323958784:0@lo:101: 00000100:00100000:2.0:1788863614.058322:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863614.058394:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.058400:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323958784 00000100:00100000:0.0:1788863614.058406:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323958784 00000100:00100000:0.0:1788863614.058449:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788863614.058457:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+14:5838:x1875759323958784:12345-0@lo:101: 00010000:00010000:0.0:1788863614.058469:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863614.058483:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0031c00/0x744cd7666bbbaa72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbaa6b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.058508:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0031c00/0x744cd7666bbbaa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbaa6b expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.058519:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0031c00/0x744cd7666bbbaa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa6b expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.058529:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031c00, rc 0) 00000100:00100000:0.0:1788863614.058579:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323958784:12345-0@lo:101: Request processed in 124us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863614.058585:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788863614.058701:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323958784:0@lo:101: 00010000:00010000:2.0:1788863614.058713:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863614.058721:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbaa72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863614.059024:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323958912:0@lo:501: 00000100:00100000:2.0:1788863614.059063:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863614.059092:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.059133:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323958912 00000100:00100000:0.0:1788863614.059137:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323958912 00000100:00100000:0.0:1788863614.059167:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788863614.059175:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323958912:12345-0@lo:501: 00000100:00100000:0.0:1788863614.059459:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323958912:12345-0@lo:501: Request processed in 284us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863614.059465:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788863614.059512:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323958912:0@lo:501: 00000100:00100000:2.0:1788863614.059538:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323959040:0@lo:503: 00000100:00100000:2.0:1788863614.059571:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863614.059587:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863614.059610:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323959040 00000100:00100000:1.0:1788863614.059621:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323959040 00000100:00100000:1.0:1788863614.059652:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788863614.059657:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323959040:12345-0@lo:503: 00000100:00100000:1.0:1788863614.060189:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323959040:12345-0@lo:503: Request processed in 529us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863614.060197:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788863614.060292:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323959040:0@lo:503: 00000100:00100000:3.0:1788863614.063293:0:8020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8020:1875759323959168:0@lo:502: 00000100:00100000:3.0:1788863614.063383:0:8020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863614.063426:0:8020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bf4a16000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.064570:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323959168 00000100:00100000:0.0:1788863614.064592:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323959168 00000100:00100000:0.0:1788863614.064652:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788863614.064773:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+15:8020:x1875759323959168:12345-0@lo:502: 00000100:00100000:0.0:1788863614.065098:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+15:8020:x1875759323959168:12345-0@lo:502: Request processed in 436us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863614.065106:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788863614.065257:0:8020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8020:1875759323959168:0@lo:502: 00000020:01000000:3.0:1788863614.065307:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863614.065316:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863614.065318:0:8020:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788863614.065323:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788863614.065325:0:8020:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788863614.065353:0:8020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8020:1875759323959296:0@lo:502: 00000100:00100000:3.0:1788863614.065396:0:8020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863614.065432:0:8020:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bf4a16000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.065639:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323959296 00000100:00100000:0.0:1788863614.065645:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323959296 00000100:00100000:0.0:1788863614.065748:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788863614.065758:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+15:8020:x1875759323959296:12345-0@lo:502: 00000100:00100000:0.0:1788863614.065906:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+15:8020:x1875759323959296:12345-0@lo:502: Request processed in 150us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863614.065913:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788863614.067075:0:8020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8020:1875759323959296:0@lo:502: 00000020:01000000:3.0:1788863614.067476:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863614.067483:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863614.067485:0:8020:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788863614.067490:0:8020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788863614.067609:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788863614.067630:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788863614.067641:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863614.067654:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863614.067665:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788863614.067667:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e8bd56cb800 from 30 10000000:01000000:2.0:1788863614.067670:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788863614.067701:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863614.067709:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863614.067719:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863614.067738:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323959424:0@lo:101: 00000100:00100000:2.0:1788863614.067889:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863614.067916:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323959424 00000100:00100000:1.0:1788863614.067923:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323959424 00000100:00100000:1.0:1788863614.067964:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788863614.067972:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323959424:12345-0@lo:101: 00010000:00010000:1.0:1788863614.067983:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863614.067995:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc13a0e00/0x744cd7666bbbaa80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbaa79 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863614.068019:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc13a0e00/0x744cd7666bbbaa80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbaa79 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863614.068029:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc13a0e00/0x744cd7666bbbaa80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa79 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863614.068061:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc13a0e00, rc 0) 00000100:00100000:1.0:1788863614.068229:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323959424:12345-0@lo:101: Request processed in 256us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863614.068236:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788863614.068273:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788863614.068288:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323959424:0@lo:101: 00010000:00010000:1.0:1788863614.068300:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863614.068320:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbaa80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863614.068378:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323959552:0@lo:501: 00000100:00100000:1.0:1788863614.068416:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863614.068432:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863614.070516:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323959552 00000100:00100000:3.0:1788863614.070531:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323959552 00000100:00100000:3.0:1788863614.070586:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788863614.070598:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323959552:12345-0@lo:501: 00000100:00100000:3.0:1788863614.071019:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323959552:12345-0@lo:501: Request processed in 423us (2601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863614.071027:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788863614.071121:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323959552:0@lo:501: 00000100:00100000:3.0:1788863614.071180:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323959680:0@lo:503: 00000100:00100000:3.0:1788863614.071234:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863614.071275:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bf4a169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863614.071299:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323959680 00000100:00100000:3.0:1788863614.071304:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323959680 00000100:00100000:3.0:1788863614.071328:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788863614.071334:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323959680:12345-0@lo:503: 00000100:00100000:3.0:1788863614.071486:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323959680:12345-0@lo:503: Request processed in 151us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863614.071493:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788863614.071534:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323959680:0@lo:503: 00000100:00100000:3.0:1788863614.071725:0:8024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8024:1875759323959808:0@lo:502: 00000100:00100000:3.0:1788863614.071763:0:8024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863614.071784:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323959808 00000100:00100000:3.0:1788863614.071788:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323959808 00000100:00100000:3.0:1788863614.071813:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788863614.071822:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:8024:x1875759323959808:12345-0@lo:502: 00000100:00100000:3.0:1788863614.072048:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:8024:x1875759323959808:12345-0@lo:502: Request processed in 228us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863614.072067:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788863614.072106:0:8024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bf4a16540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863614.072121:0:8024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8024:1875759323959808:0@lo:502: 00000100:00100000:3.0:1788863614.072165:0:8024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8024:1875759323959936:0@lo:502: 00000100:00100000:3.0:1788863614.072199:0:8024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863614.072226:0:8024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bf4a16540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.072936:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323959936 00000100:00100000:0.0:1788863614.072946:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323959936 00000100:00100000:0.0:1788863614.072982:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788863614.072991:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:8024:x1875759323959936:12345-0@lo:502: 00000100:00100000:0.0:1788863614.073218:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:8024:x1875759323959936:12345-0@lo:502: Request processed in 228us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863614.073226:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788863614.074476:0:8024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8024:1875759323959936:0@lo:502: 00000040:00080000:3.0:1788863614.074526:0:8024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788863614.074670:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788863614.074701:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788863614.074713:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.074725:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863614.074749:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788863614.074752:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e8bd56cb800 from 5 10000000:01000000:0.0:1788863614.074756:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788863614.074805:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.074814:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.074823:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863614.074844:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323960064:0@lo:101: 00000100:00100000:0.0:1788863614.074923:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863614.074970:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd28496c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863614.075193:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323960064 00000100:00100000:1.0:1788863614.075201:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323960064 00000100:00100000:1.0:1788863614.075331:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788863614.075343:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323960064:12345-0@lo:101: 00010000:00010000:1.0:1788863614.075356:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863614.075373:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc13a0800/0x744cd7666bbbaa8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbaa87 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863614.075401:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc13a0800/0x744cd7666bbbaa8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbaa87 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863614.075413:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc13a0800/0x744cd7666bbbaa8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa87 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863614.075534:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc13a0800, rc 0) 00000100:00100000:1.0:1788863614.075618:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323960064:12345-0@lo:101: Request processed in 278us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863614.075626:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788863614.075743:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323960064:0@lo:101: 00010000:00010000:0.0:1788863614.075758:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.075768:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863614.075825:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323960192:0@lo:256: 00000100:00100000:0.0:1788863614.075925:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863614.075948:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd28496c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863614.075960:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323960192 00000100:00100000:2.0:1788863614.075966:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323960192 00000100:00100000:2.0:1788863614.075998:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788863614.076006:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323960192:12345-0@lo:256: 20000000:01000000:2.0:1788863614.076026:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788863614.076061:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788863614.076065:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788863614.076169:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323960192:12345-0@lo:256: Request processed in 164us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863614.076178:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788863614.076193:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323960192:0@lo:256: 10000000:01000000:1.0:1788863614.076249:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788863614.076256:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863614.076268:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863614.076277:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788863614.076281:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788863614.076284:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788863614.076304:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863614.076311:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863614.076319:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863614.076331:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323960320:0@lo:101: 00000100:00100000:1.0:1788863614.076357:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863614.076373:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.076641:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323960320 00000100:00100000:0.0:1788863614.076647:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323960320 00000100:00100000:0.0:1788863614.076709:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788863614.076722:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323960320:12345-0@lo:101: 00010000:00010000:0.0:1788863614.076731:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863614.076741:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbaa9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbaa95 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.076756:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbaa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbaa95 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.076764:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbaa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa95 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.076771:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030800, rc 0) 00000100:00100000:0.0:1788863614.076810:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323960320:12345-0@lo:101: Request processed in 89us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863614.076816:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788863614.076993:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323960320:0@lo:101: 00010000:00010000:2.0:1788863614.077007:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa9c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863614.077016:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbaa9c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863614.077075:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323960448:0@lo:501: 00000100:00100000:2.0:1788863614.077102:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863614.077135:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.077288:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323960448 00000100:00100000:0.0:1788863614.077293:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323960448 00000100:00100000:0.0:1788863614.077353:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788863614.077362:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323960448:12345-0@lo:501: 00000100:00100000:0.0:1788863614.079344:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323960448:12345-0@lo:501: Request processed in 1973us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863614.079359:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788863614.079548:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323960448:0@lo:501: 00000100:00100000:0.0:1788863614.079598:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323960576:0@lo:503: 00000100:00100000:0.0:1788863614.079643:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863614.079682:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863614.080042:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323960576 00000100:00100000:3.0:1788863614.080072:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323960576 00000100:00100000:3.0:1788863614.080541:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788863614.080554:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323960576:12345-0@lo:503: 00000100:00100000:3.0:1788863614.082691:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323960576:12345-0@lo:503: Request processed in 2125us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863614.082709:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788863614.083213:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323960576:0@lo:503: 00000100:00100000:0.0:1788863614.083886:0:8025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8025:1875759323960704:0@lo:502: 00000100:00100000:0.0:1788863614.083951:0:8025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863614.083987:0:8025:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863614.084078:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323960704 00000100:00100000:3.0:1788863614.084086:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323960704 00000100:00100000:3.0:1788863614.084132:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788863614.084142:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:8025:x1875759323960704:12345-0@lo:502: 00000100:00100000:3.0:1788863614.084570:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:8025:x1875759323960704:12345-0@lo:502: Request processed in 430us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863614.084578:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788863614.084648:0:8025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8025:1875759323960704:0@lo:502: 00000020:01000000:1.0:1788863614.084692:0:8025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788863614.084704:0:8025:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788863614.084760:0:8025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863614.084763:0:8025:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788863614.084770:0:8025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788863614.084775:0:8025:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:1.0:1788863614.085111:0:8025:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788863614.085116:0:8025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788863614.085153:0:8025:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e8bff0319c0) 00000020:00000080:1.0:1788863614.085185:0:8025:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788863614.085192:0:8025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788863614.085290:0:8025:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788863614.085298:0:8025:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788863614.085305:0:8025:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbbaaaa 00010000:00080000:1.0:1788863614.085340:0:8025:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8bd23dd800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788863614.085611:0:8025:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788863614.086553:0:8025:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788863614.086568:0:8025:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788863614.087523:0:8025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863614.087934:0:8025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863614.088364:0:8025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788863614.088433:0:8025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788863614.089164:0:8026:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788863614.089171:0:8026:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788863614.090101:0:8025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788863614.090113:0:8025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788863614.090145:0:8025:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788863614.090169:0:8025:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x744cd7666bbbaab1 00000100:00080000:1.0:1788863614.090181:0:8025:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788863614.090195:0:8025:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8bd23dd800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788863614.090239:0:8025:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bfbbd9880 x1875759323960832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863614.090260:0:8025:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788863614.090901:0:8025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863614.090907:0:8025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863614.090909:0:8025:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788863614.090912:0:8025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863614.090915:0:8025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863614.090917:0:8025:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788863614.090919:0:8025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788863614.090983:0:8025:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788863614.091018:0:8025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8025:1875759323960960:0@lo:502: 00000100:00100000:1.0:1788863614.091111:0:8025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863614.091148:0:8025:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.091274:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759323960832:0@lo:8: 00000100:00100000:0.0:1788863614.091311:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863614.091817:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323960960 00000100:00100000:0.0:1788863614.091825:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323960960 00000100:00100000:0.0:1788863614.091906:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788863614.091918:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:8025:x1875759323960960:12345-0@lo:502: 00000100:00100000:2.0:1788863614.092023:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323961088:0@lo:400: 00000100:00100000:2.0:1788863614.092083:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863614.092113:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863614.092120:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323961216:0@lo:400: 00000100:00100000:2.0:1788863614.092143:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863614.092173:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323961344:0@lo:400: 00000100:00100000:2.0:1788863614.092201:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863614.092222:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863614.092227:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323961472:0@lo:400: 00000100:00100000:2.0:1788863614.092250:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863614.092278:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323961088 00000100:00100000:2.0:1788863614.092288:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323961088 00000100:00100000:2.0:1788863614.092332:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323961216 00000100:00100000:2.0:1788863614.092336:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323961216 00000100:00100000:2.0:1788863614.092362:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323961472 00000100:00100000:2.0:1788863614.092365:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323961472 00000100:00100000:0.0:1788863614.092466:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:8025:x1875759323960960:12345-0@lo:502: Request processed in 549us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863614.092475:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788863614.092679:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863614.092687:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323961088:12345-0@lo:400: 00000100:00100000:2.0:1788863614.092723:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323961088:12345-0@lo:400: Request processed in 38us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863614.092729:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788863614.092743:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788863614.092749:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323961216:12345-0@lo:400: 00000100:00100000:2.0:1788863614.093089:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323961216:12345-0@lo:400: Request processed in 339us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863614.093096:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788863614.093110:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788863614.093115:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323961472:12345-0@lo:400: 00000100:00100000:2.0:1788863614.093146:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323961472:12345-0@lo:400: Request processed in 31us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863614.093151:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788863614.093173:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323960832 00000100:00100000:2.0:1788863614.093177:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323960832 00000100:00100000:2.0:1788863614.093195:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323961344 00000100:00100000:2.0:1788863614.093198:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323961344 00000100:00100000:2.0:1788863614.093216:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788863614.093222:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323961344:12345-0@lo:400: 00000100:00100000:2.0:1788863614.093254:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323961344:12345-0@lo:400: Request processed in 32us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863614.093273:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788863614.093286:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788863614.093290:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875759323960832:12345-0@lo:8: 00010000:00080000:0.0:1788863614.093765:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bf4c59500 x1875759323961216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863614.093782:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323961216:0@lo:400: 00010000:00080000:0.0:1788863614.093797:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bf4c58380 x1875759323961088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863614.093806:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323961088:0@lo:400: 00010000:00080000:2.0:1788863614.094586:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 243 last 0 00000100:00100000:1.0:1788863614.094609:0:8025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8025:1875759323960960:0@lo:502: 00000020:00000080:2.0:1788863614.094619:0:6677:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x744cd7666bbbaab8 00002000:00100000:2.0:1788863614.094636:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e8bf4f1a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788863614.094640:0:6677:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000020:01000000:1.0:1788863614.094653:0:8025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863614.094662:0:8025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863614.094664:0:8025:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788863614.094670:0:8025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000001:00000004:2.0:1788863614.094703:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788863614.095021:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863614.095027:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00100000:2.0:1788863614.095258:0:6677:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788863614.095603:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788863614.095636:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8e8bf4f1d800 : changing import state from RECOVER to FULL 00000020:01000000:3.0:1788863614.096393:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788863614.096421:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788863614.096435:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa9c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863614.096447:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa9c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863614.096459:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788863614.096463:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8bc84bb380 from 1 10000000:01000000:3.0:1788863614.096466:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788863614.096506:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863614.096514:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863614.096536:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863614.096559:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323961600:0@lo:101: 00000100:00100000:3.0:1788863614.096633:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863614.096672:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bf4a169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.096732:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323961600 00000100:00100000:0.0:1788863614.096740:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323961600 00000100:00100000:0.0:1788863614.096805:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788863614.096816:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323961600:12345-0@lo:101: 00010000:00010000:0.0:1788863614.096827:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863614.096842:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0031000/0x744cd7666bbbaac6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbaabf expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.096898:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0031000/0x744cd7666bbbaac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbaabf expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.096908:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0031000/0x744cd7666bbbaac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaabf expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863614.096917:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031000, rc 0) 00000100:00100000:0.0:1788863614.096964:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323961600:12345-0@lo:101: Request processed in 149us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863614.096970:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788863614.097146:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323961600:0@lo:101: 00010000:00010000:3.0:1788863614.097162:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaac6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863614.097170:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbaac6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863614.097201:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875759323960832:12345-0@lo:8: Request processed in 3909us (5889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863614.097210:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863614.097218:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323961728:0@lo:501: 00000100:00100000:3.0:1788863614.097243:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788863614.097253:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bf4c59880 x1875759323961472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863614.097262:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bf4a169c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863614.097265:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323961472:0@lo:400: 00000100:00100000:3.0:1788863614.097273:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323961728 00010000:00080000:2.0:1788863614.097276:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bf4c5b480 x1875759323961344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863614.097277:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323961728 00000100:00100000:2.0:1788863614.097284:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323961344:0@lo:400: 00000100:00100000:3.0:1788863614.097298:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788863614.097304:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323961728:12345-0@lo:501: 00000100:00100000:3.0:1788863614.097523:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323961728:12345-0@lo:501: Request processed in 217us (278us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788863614.097530:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788863614.097558:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323961728:0@lo:501: 10000000:01000000:3.0:1788863614.097576:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788863614.097581:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaac6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863614.097594:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaac6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788863614.097729:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbd9880 x1875759323960832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788863624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863614.097740:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788863614.097758:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788863614.097766:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788863614.097772:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788863614.097775:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bd23dd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788863614.101063:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788863614.101095:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759323960832:0@lo:8: 00000004:00080000:1.0:1788863614.103470:0:8026:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788863614.104101:0:8026:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 243233247162ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788863614.146142:0:8027:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788863614.146176:0:8027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8027:1875759323961984:0@lo:7: 00000100:00100000:1.0:1788863614.146253:0:8027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863614.146287:0:8027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788863614.146322:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323961856:0@lo:13: 00000100:00100000:1.0:1788863614.146348:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863614.146396:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323961984 00000100:00100000:1.0:1788863614.146404:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323961984 00000100:00100000:1.0:1788863614.146455:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863614.146464:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8027:x1875759323961984:12345-0@lo:7: 00000100:00100000:1.0:1788863614.148607:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323961856 00000100:00100000:1.0:1788863614.148627:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323961856 00000100:00080000:1.0:1788863614.148777:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863614.148808:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863614.148822:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875759323961856:12345-0@lo:13: 00002000:00000024:1.0:1788863614.148903:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788863614.155216:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875759323961856:12345-0@lo:13: Request processed in 6382us (8850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863614.155234:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788863614.156525:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbdaa00 x1875759323961856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863614.156567:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323961856:0@lo:13: 00002000:00080000:0.0:1788863614.168632:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788863614.168641:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788863614.168890:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8027:x1875759323961984:12345-0@lo:7: Request processed in 22421us (22631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863614.168912:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788863614.169149:0:8027:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbd9880 x1875759323961984/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788863630 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863614.169165:0:8027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8027:1875759323961984:0@lo:7: 00000004:00080000:1.0:1788863614.169179:0:8027:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788863614.169224:0:8027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8027:1875759323962112:0@lo:5: 00000100:00100000:1.0:1788863614.169260:0:8027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863614.169295:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323962112 00000100:00100000:2.0:1788863614.169305:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323962112 00000100:00100000:1.0:1788863614.169306:0:8027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863614.169365:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863614.169375:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8027:x1875759323962112:12345-0@lo:5: 00002000:00080000:2.0:1788863614.169415:0:6680:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788863614.169419:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788863614.169940:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8027:x1875759323962112:12345-0@lo:5: Request processed in 565us (677us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788863614.169948:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788863614.170473:0:8027:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbd9880 x1875759323962112/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863630 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863614.170490:0:8027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8027:1875759323962112:0@lo:5: 00000004:00080000:1.0:1788863614.170503:0:8027:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788863614.170540:0:8027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8027:1875759323962240:0@lo:700: 00000100:00100000:1.0:1788863614.170580:0:8027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863614.170603:0:8027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788863614.170627:0:6686:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323962240 00000100:00100000:1.0:1788863614.170633:0:6686:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323962240 00000100:00100000:1.0:1788863614.170747:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863614.170757:0:6686:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8027:x1875759323962240:12345-0@lo:700: 00000100:00100000:1.0:1788863614.171188:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6686:1875759323962368:0@lo:700: 00000100:00100000:1.0:1788863614.171221:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863614.171238:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09600 going to sleep for 11 seconds 00000100:00100000:1.0:1788863614.171272:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323962368 00000100:00100000:1.0:1788863614.171276:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323962368 00000100:00100000:1.0:1788863614.171450:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863614.171459:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6686:x1875759323962368:12345-0@lo:700: 00000004:00080000:0.0:1788863614.189572:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788863614.254610:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788863614.266722:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6686:x1875759323962368:12345-0@lo:700: Request processed in 95255us (95490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863614.266743:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788863614.266821:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbdad80 x1875759323962368/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788863630 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863614.266843:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6686:1875759323962368:0@lo:700: 40000000:02000000:1.0:1788863614.266878:0:6686:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1788863614.362707:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788863614.362727:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788863614.363139:0:6686:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8027:x1875759323962240:12345-0@lo:700: Request processed in 192378us (192552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863614.363154:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788863614.363187:0:8027:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbdb480 x1875759323962240/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788863630 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863614.363201:0:8027:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788863614.363223:0:8027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8027:1875759323962240:0@lo:700: 00000004:02000040:3.0:1788863614.415789:0:8027:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788863614.427128:0:8027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8027:1875759323962496:0@lo:5: 00000100:00100000:3.0:1788863614.427195:0:8027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863614.427244:0:8027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863614.427564:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323962496 00000100:00100000:0.0:1788863614.427575:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323962496 00000100:00100000:0.0:1788863614.427646:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863614.427656:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8027:x1875759323962496:12345-0@lo:5: 00002000:00080000:0.0:1788863614.448177:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788863614.448306:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788863614.466597:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8027:x1875759323962496:12345-0@lo:5: Request processed in 38931us (39391us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788863614.466614:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788863614.466677:0:8027:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee497100 x1875759323962496/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788863630 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863614.466697:0:8027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8027:1875759323962496:0@lo:5: 00000004:00080000:0.0:1788863614.466719:0:8027:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788863614.935823:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863615.958508:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863616.086228:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863616.086261:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323962624:0@lo:13: 00000100:00100000:1.0:1788863616.086354:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863616.087527:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323962624 00000100:00100000:0.0:1788863616.087538:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323962624 00000100:00100000:0.0:1788863616.087606:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863616.087615:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323962624:12345-0@lo:13: 00002000:00000024:0.0:1788863616.087654:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863616.087738:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323962624:12345-0@lo:13: Request processed in 124us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863616.087745:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788863616.087840:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bc8517100 x1875759323962624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863616.087889:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323962624:0@lo:13: 00000100:00080000:1.0:1788863616.088537:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788863616.982156:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863618.011564:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788863618.445013:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1788863618.936778:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863618.936878:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298773120 00000100:00100000:3.0:1788863618.937395:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298773120 00000100:00100000:3.0:1788863618.937460:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:3.0:1788863618.937473:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2349:x1875759298773120:12345-192.168.204.51@tcp:250: 00010000:00080000:3.0:1788863618.937517:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2d6e1829-9c4d-46c0-a707-b9ed128736b1@192.168.204.51@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:3.0:1788863618.937555:0:5835:0:(genops.c:1384:class_connect()) connect: client 2d6e1829-9c4d-46c0-a707-b9ed128736b1, cookie 0x744cd7666bbbaacd 00000100:00080000:3.0:1788863618.937732:0:5835:0:(import.c:65:import_set_state_nolock()) ffff8e8bf4c46000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863618.937822:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+5:2349:x1875759298773120:12345-192.168.204.51@tcp:250: Request processed in 351us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863618.937831:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:1.0:1788863618.951079:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863618.951131:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298773248 00000100:00100000:1.0:1788863618.951143:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298773248 00000100:00100000:1.0:1788863618.951206:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:1.0:1788863618.951229:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+5:5580:x1875759298773248:12345-192.168.204.51@tcp:101: 00010000:00010000:1.0:1788863618.951263:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863618.951290:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc13a1e00/0x744cd7666bbbaad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330d2e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863618.951340:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc13a1e00/0x744cd7666bbbaad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d2e expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863618.951353:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc13a1e00/0x744cd7666bbbaad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d2e expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863618.951365:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc13a1e00, rc 0) 00000100:00100000:1.0:1788863618.951442:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+6:5580:x1875759298773248:12345-192.168.204.51@tcp:101: Request processed in 214us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863618.951450:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:3.0:1788863618.955727:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863618.955780:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298773376 00000100:00100000:3.0:1788863618.955793:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298773376 00000100:00100000:3.0:1788863618.955889:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:3.0:1788863618.955900:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+6:5580:x1875759298773376:12345-192.168.204.51@tcp:501: 00000100:00100000:3.0:1788863618.956179:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+6:5580:x1875759298773376:12345-192.168.204.51@tcp:501: Request processed in 280us (469us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788863618.956188:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:1.0:1788863618.960521:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863618.960557:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298773504 00000100:00100000:1.0:1788863618.960567:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298773504 00000100:00100000:1.0:1788863618.960615:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:1.0:1788863618.960624:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+6:5580:x1875759298773504:12345-192.168.204.51@tcp:101: 00010000:00010000:1.0:1788863618.960643:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863618.960664:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaadb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330d35 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863618.960693:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaadb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d35 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863618.960704:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaadb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d35 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863618.960713:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc13a1400, rc 0) 00000100:00100000:1.0:1788863618.960770:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+7:5580:x1875759298773504:12345-192.168.204.51@tcp:101: Request processed in 147us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863618.960788:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:3.0:1788863618.966151:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863618.966213:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298773632 00000100:00100000:3.0:1788863618.966229:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298773632 00000100:00100000:3.0:1788863618.966295:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:3.0:1788863618.966313:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+7:5580:x1875759298773632:12345-192.168.204.51@tcp:501: 00000100:00100000:3.0:1788863618.966666:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+8:5580:x1875759298773632:12345-192.168.204.51@tcp:501: Request processed in 355us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863618.966675:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:3.0:1788863618.969901:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863618.970022:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298773760 00000100:00100000:2.0:1788863618.970032:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298773760 00000100:00100000:2.0:1788863618.970088:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:2.0:1788863618.970098:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+8:5580:x1875759298773760:12345-192.168.204.51@tcp:503: 00000100:00100000:2.0:1788863618.970387:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+8:5580:x1875759298773760:12345-192.168.204.51@tcp:503: Request processed in 281us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863618.970395:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:2.0:1788863618.980793:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863618.982415:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298773888 00000100:00100000:3.0:1788863618.982436:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298773888 00000100:00100000:3.0:1788863618.982509:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:3.0:1788863618.982522:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+8:5600:x1875759298773888:12345-192.168.204.51@tcp:502: 00000100:00100000:3.0:1788863618.982964:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+8:5600:x1875759298773888:12345-192.168.204.51@tcp:502: Request processed in 435us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863618.982980:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:0.0:1788863619.020705:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863619.020802:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298774016 00000100:00100000:1.0:1788863619.020812:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298774016 00000100:00100000:1.0:1788863619.020884:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:1.0:1788863619.020895:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+8:5600:x1875759298774016:12345-192.168.204.51@tcp:502: 00000100:00100000:1.0:1788863619.021177:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+8:5600:x1875759298774016:12345-192.168.204.51@tcp:502: Request processed in 283us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863619.021186:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 118 00010000:00010000:2.0:1788863619.030231:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863619.033770:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863619.034003:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298774144 00000100:00100000:2.0:1788863619.034016:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298774144 00000100:00100000:2.0:1788863619.034089:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:2.0:1788863619.034101:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+8:5580:x1875759298774144:12345-192.168.204.51@tcp:101: 00010000:00010000:2.0:1788863619.034121:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863619.034139:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8c021c7800/0x744cd7666bbbaae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330d5f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863619.034168:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8c021c7800/0x744cd7666bbbaae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d5f expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863619.034201:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8c021c7800/0x744cd7666bbbaae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d5f expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863619.040622:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8c021c7800, rc 0) 00000100:00100000:2.0:1788863619.040992:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:5580:x1875759298774144:12345-192.168.204.51@tcp:101: Request processed in 6886us (7232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863619.041002:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:1.0:1788863619.047796:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863619.048133:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298774272 00000100:00100000:3.0:1788863619.048146:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298774272 00000100:00100000:3.0:1788863619.048240:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:3.0:1788863619.048255:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:5580:x1875759298774272:12345-192.168.204.51@tcp:256: 20000000:01000000:3.0:1788863619.048750:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788863619.048785:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788863619.048789:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788863619.048792:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788863619.048795:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788863619.052078:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:5580:x1875759298774272:12345-192.168.204.51@tcp:256: Request processed in 3812us (4284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863619.052097:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:2.0:1788863619.057166:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863619.057739:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298774400 00000100:00100000:1.0:1788863619.057757:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298774400 00000100:00100000:1.0:1788863619.057833:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:1.0:1788863619.057845:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:5580:x1875759298774400:12345-192.168.204.51@tcp:101: 00010000:00010000:1.0:1788863619.057894:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863619.057920:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc13a1800/0x744cd7666bbbaae9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330d66 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863619.057978:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc13a1800/0x744cd7666bbbaae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d66 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863619.057991:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc13a1800/0x744cd7666bbbaae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d66 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863619.058001:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc13a1800, rc 0) 00000100:00100000:1.0:1788863619.058061:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5580:x1875759298774400:12345-192.168.204.51@tcp:101: Request processed in 219us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863619.058069:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:2.0:1788863619.064565:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863619.064649:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298774528 00000100:00100000:3.0:1788863619.064660:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298774528 00000100:00100000:3.0:1788863619.064716:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:3.0:1788863619.064727:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5580:x1875759298774528:12345-192.168.204.51@tcp:501: 00000100:00100000:3.0:1788863619.065048:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5580:x1875759298774528:12345-192.168.204.51@tcp:501: Request processed in 321us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863619.065056:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:3.0:1788863619.081461:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863619.081635:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298774656 00000100:00100000:0.0:1788863619.081648:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298774656 00000100:00100000:0.0:1788863619.081705:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:0.0:1788863619.081717:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5580:x1875759298774656:12345-192.168.204.51@tcp:503: 00000100:00100000:0.0:1788863619.082127:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5580:x1875759298774656:12345-192.168.204.51@tcp:503: Request processed in 410us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863619.082135:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:2.0:1788863619.091256:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863619.091324:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298774784 00000100:00100000:2.0:1788863619.091338:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298774784 00000100:00100000:2.0:1788863619.091584:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:2.0:1788863619.091596:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5602:x1875759298774784:12345-192.168.204.51@tcp:502: 00000100:00100000:2.0:1788863619.091984:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5602:x1875759298774784:12345-192.168.204.51@tcp:502: Request processed in 388us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863619.091994:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:2.0:1788863619.097688:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863619.098352:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298774912 00000100:00100000:3.0:1788863619.098367:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298774912 00000100:00100000:3.0:1788863619.098441:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:3.0:1788863619.098454:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5602:x1875759298774912:12345-192.168.204.51@tcp:502: 00000100:00100000:3.0:1788863619.098806:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5602:x1875759298774912:12345-192.168.204.51@tcp:502: Request processed in 354us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863619.098821:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:0.0:1788863619.104971:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863619.105423:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298775040 00000100:00100000:1.0:1788863619.105439:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298775040 00000100:00100000:1.0:1788863619.105508:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1788863619.105520:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1875759298775040:12345-192.168.204.51@tcp:38: 00010000:00080000:1.0:1788863619.105571:0:5841:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:1.0:1788863619.105647:0:5841:0:(genops.c:1384:class_connect()) connect: client 6fd3bcef-c680-4c25-aae1-ecd03903ad0a, cookie 0x744cd7666bbbaaf0 00000004:00100000:1.0:1788863619.105693:0:5841:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788863619.105701:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788863619.150189:0:5841:0:(import.c:65:import_set_state_nolock()) ffff8e8bd23db000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863619.151525:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2349:x1875759298775040:12345-192.168.204.51@tcp:38: Request processed in 46001us (46576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863619.151547:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1788863619.160777:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759323962880:0@lo:400: 00000100:00100000:1.0:1788863619.160845:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863619.160949:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323962752:0@lo:400: 00000100:00100000:2.0:1788863619.160996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863619.161042:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323963264:0@lo:400: 00000100:00100000:2.0:1788863619.161066:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323963136:0@lo:400: 00000100:00100000:2.0:1788863619.161088:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863619.161117:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863619.161132:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759323963008:0@lo:400: 00000100:00100000:2.0:1788863619.161164:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323963136 00000100:00100000:2.0:1788863619.161171:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323963136 00000100:00100000:3.0:1788863619.161325:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323962752 00000100:00100000:3.0:1788863619.161329:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323962752 00000100:00100000:3.0:1788863619.161380:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788863619.161389:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323962752:12345-0@lo:400: 00000100:00100000:3.0:1788863619.161454:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323962752:12345-0@lo:400: Request processed in 66us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863619.161461:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788863619.162526:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788863619.162535:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323963136:12345-0@lo:400: 00000100:00100000:2.0:1788863619.162587:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323963136:12345-0@lo:400: Request processed in 54us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863619.162594:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863619.162780:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323963392:0@lo:400: 00000100:00100000:1.0:1788863619.162811:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788863619.162841:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863619.162942:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863619.163013:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323963392 00000100:00100000:1.0:1788863619.163020:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323963392 00000100:00100000:1.0:1788863619.163063:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863619.163069:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323963392:12345-0@lo:400: 00000100:00100000:1.0:1788863619.163107:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323963392:12345-0@lo:400: Request processed in 39us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863619.163113:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788863619.163144:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bffdcc700 x1875759323963392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863619.163169:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788863619.163183:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323963392:0@lo:400: 00000100:00080000:2.0:1788863619.163433:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863619.163518:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323962880 00000100:00100000:0.0:1788863619.163524:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323962880 00000100:00100000:0.0:1788863619.163568:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863619.163575:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759323962880:12345-0@lo:400: 00000100:00100000:0.0:1788863619.163614:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759323962880:12345-0@lo:400: Request processed in 40us (2769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863619.163620:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863619.163642:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323963520:0@lo:13: 00000100:00100000:0.0:1788863619.163834:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863619.163938:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323963520 00000100:00100000:2.0:1788863619.163942:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323963520 00000100:00100000:2.0:1788863619.163979:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788863619.163985:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323963520:12345-0@lo:13: 00002000:00000024:2.0:1788863619.164018:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863619.164454:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323963008 00000100:00100000:0.0:1788863619.164460:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323963008 00000100:00100000:0.0:1788863619.164495:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788863619.164502:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759323963008:12345-0@lo:400: 00000100:00100000:2.0:1788863619.164849:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323963520:12345-0@lo:13: Request processed in 862us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863619.164884:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788863619.164936:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bc8514e00 x1875759323963520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863619.164969:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323963520:0@lo:13: 00000100:00080000:2.0:1788863619.164997:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788863619.165160:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbda680 x1875759323962880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863619.165170:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759323962880:0@lo:400: 00010000:00080000:3.0:1788863619.165645:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbdb480 x1875759323963136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863619.165655:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323963136:0@lo:400: 00000100:00100000:2.0:1788863619.165928:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863619.165977:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323962752:0@lo:400: 00000100:00100000:1.0:1788863619.166036:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323963264 00000100:00100000:1.0:1788863619.166042:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323963264 00000100:00100000:1.0:1788863619.166087:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863619.166095:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323963264:12345-0@lo:400: 00000100:00100000:1.0:1788863619.166147:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323963264:12345-0@lo:400: Request processed in 54us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863619.166154:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788863619.166393:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788863619.166414:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbd9880 x1875759323963264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863619.166425:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323963264:0@lo:400: 00000100:00100000:0.0:1788863619.166561:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759323963008:12345-0@lo:400: Request processed in 2058us (3618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863619.166569:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788863619.168992:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbda300 x1875759323963008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863619.169012:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759323963008:0@lo:400: 00010000:00010000:0.0:1788863620.054781:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863620.160649:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863620.160834:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863620.167397:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298775168 00000100:00100000:1.0:1788863620.167417:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298775168 00000100:00100000:1.0:1788863620.167511:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298775296 00000100:00100000:1.0:1788863620.167515:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298775296 00000100:00100000:1.0:1788863620.167546:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1788863620.167557:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:0:x1875759298775168:12345-192.168.204.51@tcp:41: 00000004:00000024:1.0:1788863620.167619:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788863620.167733:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:0:x1875759298775168:12345-192.168.204.51@tcp:41: Request processed in 177us (7110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863620.167741:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1788863620.167762:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1788863620.167768:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:5580:x1875759298775296:12345-192.168.204.51@tcp:41: 00000004:00000024:1.0:1788863620.167780:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788863620.167818:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:5580:x1875759298775296:12345-192.168.204.51@tcp:41: Request processed in 51us (6987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863620.167824:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00080000:2.0:1788863620.168537:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863620.176259:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863620.176360:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298775424 00000100:00100000:1.0:1788863620.176372:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298775424 00000100:00100000:1.0:1788863620.176434:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1788863620.176445:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:5580:x1875759298775424:12345-192.168.204.51@tcp:40: 00000100:00100000:1.0:1788863620.176541:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:5580:x1875759298775424:12345-192.168.204.51@tcp:40: Request processed in 97us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863620.176549:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1788863620.183238:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863620.183319:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863620.183397:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298775552 00000100:00100000:2.0:1788863620.183408:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298775552 00000100:00100000:2.0:1788863620.183452:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1788863620.183460:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1875759298775552:12345-192.168.204.51@tcp:8: 00010000:00080000:2.0:1788863620.183495:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:2.0:1788863620.183531:0:6677:0:(genops.c:1384:class_connect()) connect: client 6fd3bcef-c680-4c25-aae1-ecd03903ad0a, cookie 0x744cd7666bbbaaf7 00002000:00100000:2.0:1788863620.183543:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6fd3bcef-c680-4c25-aae1-ecd03903ad0a/ffff8e8bf4f1d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788863620.183571:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788863620.183994:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788863620.184030:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8e8bf4f1e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788863620.184098:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2349:x1875759298775552:12345-192.168.204.51@tcp:8: Request processed in 637us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863620.184106:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788863620.184240:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298775808 00000100:00100000:1.0:1788863620.184245:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298775808 00000100:00100000:1.0:1788863620.184289:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:1.0:1788863620.184297:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2351:x1875759298775808:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1788863620.184328:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2351:x1875759298775808:12345-192.168.204.51@tcp:400: Request processed in 32us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863620.184335:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:2.0:1788863620.189828:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863620.189996:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863620.190612:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298775936 00000100:00100000:1.0:1788863620.190626:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298775936 00000100:00100000:1.0:1788863620.190707:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1788863620.190720:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:5580:x1875759298775936:12345-192.168.204.51@tcp:33: 00000100:00100000:0.0:1788863620.197092:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298775680 00000100:00100000:0.0:1788863620.197109:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298775680 00000100:00100000:0.0:1788863620.197167:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1788863620.197175:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1875759298775680:12345-192.168.204.51@tcp:8: 00010000:00080000:0.0:1788863620.197211:0:6680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:0.0:1788863620.197267:0:6680:0:(genops.c:1384:class_connect()) connect: client 6fd3bcef-c680-4c25-aae1-ecd03903ad0a, cookie 0x744cd7666bbbaafe 00002000:00100000:0.0:1788863620.197292:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6fd3bcef-c680-4c25-aae1-ecd03903ad0a/ffff8e8bd2994000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788863620.197306:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788863620.197701:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788863620.197740:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8e8bd2993800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863620.197843:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2349:x1875759298775680:12345-192.168.204.51@tcp:8: Request processed in 666us (8031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863620.197874:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000004:00080000:1.0:1788863620.229900:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39067us 00000004:00200000:1.0:1788863620.278973:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788863620.280224:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:5580:x1875759298775936:12345-192.168.204.51@tcp:33: Request processed in 89495us (90215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863620.280238:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1788863620.538581:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863620.538683:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298776064 00000100:00100000:1.0:1788863620.538695:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298776064 00000100:00100000:1.0:1788863620.538760:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1788863620.538771:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:5620:x1875759298776064:12345-192.168.204.51@tcp:101: 00010000:00010000:1.0:1788863620.538791:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863620.538816:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc13a0600/0x744cd7666bbbab05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330d90 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863620.538910:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc13a0200/0x744cd7666bbbab0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863620.538935:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc13a0200/0x744cd7666bbbab0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863620.538951:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc13a0200/0x744cd7666bbbab0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863620.538988:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788863620.538992:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788863620.539007:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc13a0200/0x744cd7666bbbab0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863620.539034:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc13a0600/0x744cd7666bbbab05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d90 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863620.539054:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc13a0200/0x744cd7666bbbab0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d90 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863620.539062:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bd4f5a200) 00010000:00010000:1.0:1788863620.539065:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863620.539084:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc13a0200, rc 0) 00000100:00100000:1.0:1788863620.539158:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:5620:x1875759298776064:12345-192.168.204.51@tcp:101: Request processed in 388us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863620.539164:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00010000:00010000:2.0:1788863621.078984:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863621.206453:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323963648:0@lo:13: 00000100:00100000:3.0:1788863621.206561:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863621.207169:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323963648 00000100:00100000:0.0:1788863621.207179:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323963648 00000100:00100000:0.0:1788863621.207265:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863621.207276:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323963648:12345-0@lo:13: 00002000:00000024:0.0:1788863621.207308:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863621.207378:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323963648:12345-0@lo:13: Request processed in 103us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863621.207386:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788863621.207511:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788863621.210417:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bc8514e00 x1875759323963648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863621.210451:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323963648:0@lo:13: 00010000:00010000:0.0:1788863622.102604:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863622.937093:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863622.940275:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298776192 00000100:00100000:1.0:1788863622.940294:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298776192 00000100:00100000:1.0:1788863622.940405:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788863622.940418:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:5672:x1875759298776192:12345-192.168.204.51@tcp:41: 00000004:00000024:1.0:1788863622.940472:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788863622.940566:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:5672:x1875759298776192:12345-192.168.204.51@tcp:41: Request processed in 150us (3488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863622.940574:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00080000:2.0:1788863622.941289:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863622.948552:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863622.949117:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298776320 00000100:00100000:0.0:1788863622.949129:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298776320 00000100:00100000:0.0:1788863622.949217:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1788863622.949240:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:5672:x1875759298776320:12345-192.168.204.51@tcp:13: 00002000:00000024:0.0:1788863622.949294:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788863622.949363:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863622.949389:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:5672:x1875759298776320:12345-192.168.204.51@tcp:13: Request processed in 162us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863622.949397:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1788863622.953171:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863622.953287:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298776448 00000100:00100000:2.0:1788863622.953298:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298776448 00000100:00100000:2.0:1788863622.953366:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1788863622.953383:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:5672:x1875759298776448:12345-192.168.204.51@tcp:13: 00002000:00000024:2.0:1788863622.953424:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863622.953499:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:5672:x1875759298776448:12345-192.168.204.51@tcp:13: Request processed in 119us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863622.953506:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00080000:1.0:1788863622.953731:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788863623.126249:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788863623.848075:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00010000:00010000:3.0:1788863624.150791:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863624.278142:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863624.278174:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323963776:0@lo:13: 00000100:00100000:0.0:1788863624.278274:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863624.278348:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323963776 00000100:00100000:0.0:1788863624.278358:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323963776 00000100:00100000:0.0:1788863624.278427:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788863624.278441:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323963776:12345-0@lo:13: 00002000:00000024:0.0:1788863624.278475:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863624.278533:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323963776:12345-0@lo:13: Request processed in 94us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863624.278540:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788863624.278565:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788863624.278602:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bc8515c00 x1875759323963776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863624.278644:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323963776:0@lo:13: 00000100:00100000:2.0:1788863624.281792:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323964288:0@lo:400: 00000100:00100000:2.0:1788863624.281917:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863624.281959:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788863624.281965:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323963904:0@lo:400: 00000100:00100000:2.0:1788863624.282000:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863624.282039:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323964416:0@lo:400: 00000100:00100000:2.0:1788863624.282066:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863624.282100:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323964032:0@lo:400: 00000100:00100000:2.0:1788863624.282145:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863624.282172:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863624.282176:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323964160:0@lo:400: 00000100:00100000:2.0:1788863624.282199:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863624.282455:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323964288 00000100:00100000:0.0:1788863624.282465:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323964288 00000100:00100000:0.0:1788863624.282537:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863624.282546:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323964288:12345-0@lo:400: 00000100:00100000:0.0:1788863624.282622:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323964288:12345-0@lo:400: Request processed in 64us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863624.282630:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863624.282654:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323964416 00000100:00100000:0.0:1788863624.282657:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323964416 00000100:00100000:0.0:1788863624.282684:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323964032 00000100:00100000:0.0:1788863624.282687:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323964032 00000100:00100000:0.0:1788863624.282700:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323964160 00000100:00100000:0.0:1788863624.282702:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323964160 00000100:00100000:0.0:1788863624.282730:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863624.282737:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323964416:12345-0@lo:400: 00000100:00100000:0.0:1788863624.282772:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323964416:12345-0@lo:400: Request processed in 36us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863624.282777:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863624.282788:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863624.282794:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323964032:12345-0@lo:400: 00000100:00100000:0.0:1788863624.282825:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323964032:12345-0@lo:400: Request processed in 32us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863624.282831:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863624.282842:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788863624.282848:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323964160:12345-0@lo:400: 00000100:00100000:0.0:1788863624.282910:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323964160:12345-0@lo:400: Request processed in 62us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863624.282916:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788863624.282932:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863624.282937:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863624.282985:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323964416:0@lo:400: 00010000:00080000:0.0:1788863624.283001:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee335500 x1875759323964288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863624.283011:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323964288:0@lo:400: 00000100:00100000:0.0:1788863624.283047:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323964160:0@lo:400: 00000100:00100000:0.0:1788863624.283058:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323964032:0@lo:400: 00000100:00100000:3.0:1788863624.284113:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323963904 00000100:00100000:3.0:1788863624.284126:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323963904 00000100:00100000:3.0:1788863624.284179:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788863624.284190:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323963904:12345-0@lo:400: 00000100:00100000:3.0:1788863624.284784:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323963904:12345-0@lo:400: Request processed in 594us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863624.284793:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788863624.293044:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323963904:0@lo:400: 00000001:00100000:2.0:1788863624.371547:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000001:00100000:3.0:1788863624.896112:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00010000:00010000:3.0:1788863625.174887:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863625.533891:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863625.534158:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863625.534203:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863625.534232:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863625.534263:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298776960 00000100:00100000:1.0:1788863625.534274:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298776960 00000100:00100000:1.0:1788863625.534336:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298776832 00000100:00100000:1.0:1788863625.534340:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298776832 00000100:00100000:1.0:1788863625.534359:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1788863625.534368:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298776960:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1788863625.534444:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298776960:12345-192.168.204.51@tcp:400: Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863625.534452:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1788863625.534468:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788863625.534490:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298776832:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1788863625.534517:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298776832:12345-192.168.204.51@tcp:400: Request processed in 28us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863625.534523:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00080000:1.0:1788863625.534539:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863625.534543:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863625.534772:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298776576 00000100:00100000:3.0:1788863625.534778:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298776576 00000100:00100000:3.0:1788863625.535076:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:3.0:1788863625.535087:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2350:x1875759298776576:12345-192.168.204.51@tcp:400: 00000100:00100000:3.0:1788863625.535122:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2350:x1875759298776576:12345-192.168.204.51@tcp:400: Request processed in 38us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863625.535128:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:0.0:1788863625.535256:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298776704 00000100:00100000:0.0:1788863625.535262:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298776704 00000100:00100000:0.0:1788863625.535304:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1788863625.535312:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298776704:12345-192.168.204.51@tcp:400: 00000100:00100000:0.0:1788863625.535349:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298776704:12345-192.168.204.51@tcp:400: Request processed in 39us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863625.535355:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00080000:1.0:1788863625.537196:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788863625.993211:0:8289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788863626.203532:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863626.329770:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323964544:0@lo:13: 00000100:00100000:2.0:1788863626.329935:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863626.330070:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323964544 00000100:00100000:3.0:1788863626.330079:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323964544 00000100:00100000:3.0:1788863626.330165:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788863626.330176:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323964544:12345-0@lo:13: 00002000:00000024:3.0:1788863626.330221:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788863626.330234:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863626.331483:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323964544:12345-0@lo:13: Request processed in 1300us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863626.331497:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788863626.331592:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bc8515c00 x1875759323964544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863626.331623:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323964544:0@lo:13: 00010000:00010000:2.0:1788863627.222169:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863628.248606:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863629.272209:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863629.400288:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323964672:0@lo:13: 00000100:00100000:0.0:1788863629.400416:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863629.400767:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323964672 00000100:00100000:3.0:1788863629.400795:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323964672 00000100:00100000:3.0:1788863629.400914:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788863629.400928:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323964672:12345-0@lo:13: 00002000:00000024:3.0:1788863629.400988:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863629.401052:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323964672:12345-0@lo:13: Request processed in 127us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863629.401061:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788863629.401304:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863629.402763:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759323964928:0@lo:400: 00000100:00100000:3.0:1788863629.402876:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788863629.403047:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bc8514700 x1875759323964672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863629.403075:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323964672:0@lo:13: 00000100:00100000:0.0:1788863629.403107:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323965184:0@lo:400: 00000100:00100000:0.0:1788863629.403141:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.403166:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863629.403172:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759323965056:0@lo:400: 00000100:00100000:0.0:1788863629.403196:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.403237:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323964800:0@lo:400: 00000100:00100000:0.0:1788863629.403274:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.403303:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323965312:0@lo:400: 00000100:00100000:0.0:1788863629.403325:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.403362:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323965184 00000100:00100000:0.0:1788863629.403371:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323965184 00000100:00100000:0.0:1788863629.403443:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788863629.403455:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323965184:12345-0@lo:400: 00000100:00100000:0.0:1788863629.403528:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323965184:12345-0@lo:400: Request processed in 75us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.403536:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788863629.403566:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323964928 00000100:00100000:0.0:1788863629.403570:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323964928 00000100:00100000:0.0:1788863629.403595:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323965056 00000100:00100000:0.0:1788863629.403598:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323965056 00000100:00100000:0.0:1788863629.403612:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323965312 00000100:00100000:0.0:1788863629.403614:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323965312 00000100:00100000:0.0:1788863629.403628:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863629.403634:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759323964928:12345-0@lo:400: 00000100:00100000:0.0:1788863629.403670:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759323964928:12345-0@lo:400: Request processed in 36us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.403677:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863629.403691:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788863629.403696:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759323965056:12345-0@lo:400: 00000100:00100000:0.0:1788863629.403724:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759323965056:12345-0@lo:400: Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.403730:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788863629.403742:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788863629.403747:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323965312:12345-0@lo:400: 00000100:00100000:0.0:1788863629.403794:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323965312:12345-0@lo:400: Request processed in 46us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.403800:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788863629.403842:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323965312:0@lo:400: 00000100:00100000:0.0:1788863629.403901:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759323965056:0@lo:400: 00010000:00080000:0.0:1788863629.403927:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff747800 x1875759323965184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863629.403937:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323965184:0@lo:400: 00000100:00100000:0.0:1788863629.403992:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323964800 00000100:00100000:0.0:1788863629.403997:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323964800 00000100:00100000:0.0:1788863629.404028:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788863629.404036:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323964800:12345-0@lo:400: 00000100:00100000:0.0:1788863629.404075:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323964800:12345-0@lo:400: Request processed in 41us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.404082:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788863629.404125:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323964800:0@lo:400: 00000100:00080000:0.0:1788863629.414723:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863629.414744:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863629.415783:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759323964928:0@lo:400: 00000020:00000080:0.0:1788863629.945985:0:8436:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee2984520 20000000:00000080:0.0:1788863629.946008:0:8436:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8bffe79c00 uarg=0000000000000000 20000000:01000000:0.0:1788863629.946056:0:8436:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788863629.946060:0:8436:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788863629.946064:0:8436:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788863629.946070:0:8436:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788863629.946076:0:8436:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788863629.946095:0:8436:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788863629.946098:0:8436:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788863629.946372:0:8436:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788863629.946375:0:8436:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788863629.953210:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788863629.961498:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788863629.963285:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788863629.963336:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788863629.963363:0:8436:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788863629.963367:0:8436:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788863629.970776:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788863629.971973:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788863629.972421:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788863629.972463:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788863629.972485:0:8436:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788863629.972490:0:8436:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788863629.976753:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788863629.978260:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788863629.978330:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788863629.978391:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788863629.978411:0:8436:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788863629.978414:0:8436:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788863629.986328:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788863629.988442:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788863629.988528:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788863629.988574:0:8436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1788863629.988605:0:8436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788863629.988646:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.988766:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bffc17800/0x744cd7666bbbaa10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa09 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.988775:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc0030400/0x744cd7666bbbaa3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa33 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.988784:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbbaa64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa5d expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.988792:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc0031c00/0x744cd7666bbbaa72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa6b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.988815:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc13a0e00/0x744cd7666bbbaa80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa79 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.988824:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbaa9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa95 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.988832:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc0031000/0x744cd7666bbbaac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaabf expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.988845:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc13a1e00/0x744cd7666bbbaad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d2e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.989487:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaadb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d35 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.989501:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.989581:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaadb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d35 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.989607:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaadb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d35 expref: 9 pid: 5832 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863629.989630:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323965440:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788863629.990042:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc13a1e00/0x744cd7666bbbaad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d2e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.990053:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bc13a1e00/0x744cd7666bbbaad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d2e expref: 9 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863629.990083:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323965568:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788863629.990122:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc0031000/0x744cd7666bbbaac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbaabf expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.990131:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc0031000/0x744cd7666bbbaac6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbaabf expref: 18 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863629.990143:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323965696:0@lo:104: 00000100:00100000:3.0:1788863629.990211:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863629.990264:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbaa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbaa95 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.990272:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbaa9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbaa95 expref: 18 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863629.990281:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff747480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323965824:0@lo:104: 00000100:00100000:3.0:1788863629.990315:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863629.990355:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc13a0e00/0x744cd7666bbbaa80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbaa79 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.990362:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc13a0e00/0x744cd7666bbbaa80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbaa79 expref: 18 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863629.990370:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff747b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323965952:0@lo:104: 00010000:00010000:3.0:1788863629.990397:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc0031c00/0x744cd7666bbbaa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbaa6b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.990405:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc0031c00/0x744cd7666bbbaa72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbaa6b expref: 18 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863629.990422:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323966080:0@lo:104: 00010000:00010000:3.0:1788863629.990451:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbbaa64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbaa5d expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.990459:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbbaa64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbaa5d expref: 18 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863629.990468:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323966208:0@lo:104: 00010000:00010000:3.0:1788863629.990494:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc0030400/0x744cd7666bbbaa3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbaa33 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.990502:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc0030400/0x744cd7666bbbaa3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbaa33 expref: 18 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863629.990511:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323966336:0@lo:104: 00010000:00010000:3.0:1788863629.990538:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bffc17800/0x744cd7666bbbaa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbaa09 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863629.990546:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bffc17800/0x744cd7666bbbaa10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbaa09 expref: 18 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863629.990556:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323966464:0@lo:104: 00000100:00100000:3.0:1788863629.990578:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863629.991351:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788863629.991397:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.991426:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.991438:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.991472:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.991484:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.991506:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323965696 00000100:00100000:0.0:1788863629.991521:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323965696 00000100:00100000:0.0:1788863629.991584:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323965824 00000100:00100000:0.0:1788863629.991588:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323965824 00000100:00100000:0.0:1788863629.991605:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323965952 00000100:00100000:0.0:1788863629.991607:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323965952 00000100:00100000:0.0:1788863629.991617:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323966080 00000100:00100000:0.0:1788863629.991619:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323966080 00000100:00100000:0.0:1788863629.991630:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323966208 00000100:00100000:0.0:1788863629.991631:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323966208 00000100:00100000:0.0:1788863629.991638:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323966336 00000100:00100000:0.0:1788863629.991640:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323966336 00000100:00100000:0.0:1788863629.991651:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323966464 00000100:00100000:0.0:1788863629.991669:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323966464 00000100:00100000:0.0:1788863629.991685:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788863629.991694:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+9:8436:x1875759323965696:12345-0@lo:104: 00010000:00010000:0.0:1788863629.991717:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaac6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.991812:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788863629.991818:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+9:8436:x1875759323965696:12345-0@lo:104: Request processed in 125us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.991825:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788863629.991847:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788863629.991888:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff227450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+8:8436:x1875759323965824:12345-0@lo:104: 00010000:00010000:0.0:1788863629.991897:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa9c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.991934:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788863629.991946:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff227450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+8:8436:x1875759323965824:12345-0@lo:104: Request processed in 94us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.991952:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788863629.991992:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863629.991999:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+7:8436:x1875759323965952:12345-0@lo:104: 00010000:00010000:0.0:1788863629.992140:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.992175:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788863629.992180:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+7:8436:x1875759323965952:12345-0@lo:104: Request processed in 183us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.992186:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863629.992199:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863629.992206:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+6:8436:x1875759323966080:12345-0@lo:104: 00010000:00010000:0.0:1788863629.992215:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.992240:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788863629.992245:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+6:8436:x1875759323966080:12345-0@lo:104: Request processed in 40us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.992251:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863629.992265:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863629.992271:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee496a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+5:8436:x1875759323966208:12345-0@lo:104: 00010000:00010000:0.0:1788863629.992278:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa64 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.992305:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788863629.992316:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee496a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+5:8436:x1875759323966208:12345-0@lo:104: Request processed in 46us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.992322:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863629.992336:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788863629.992342:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+4:8436:x1875759323966336:12345-0@lo:104: 00010000:00010000:0.0:1788863629.992352:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa3a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.992379:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788863629.992383:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+4:8436:x1875759323966336:12345-0@lo:104: Request processed in 42us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.992389:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788863629.992401:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863629.992406:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+3:8436:x1875759323966464:12345-0@lo:104: 00010000:00010000:0.0:1788863629.992413:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa10 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.992437:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788863629.992441:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+3:8436:x1875759323966464:12345-0@lo:104: Request processed in 36us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.992445:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788863629.992473:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788863629.992483:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaac6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.992492:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16a00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:0.0:1788863629.992498:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbaac6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.992522:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbaac6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863629.992532:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbaac6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863629.992540:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788863629.992601:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaac6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.992609:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863629.992637:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaac6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.992645:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbaabf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaac6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.993530:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788863629.993844:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788863629.993878:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.993889:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8c021c6200 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:0.0:1788863629.993893:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbaa80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.993903:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbaa80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863629.993911:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbaa80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863629.993931:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788863629.993972:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.993979:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788863629.994313:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323965696:0@lo:104: 00000100:00100000:3.0:1788863629.994329:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff747480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323965824:0@lo:104: 00000100:00100000:3.0:1788863629.994338:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff747b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323965952:0@lo:104: 00000100:00100000:3.0:1788863629.994347:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323966080:0@lo:104: 00000100:00100000:3.0:1788863629.994367:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323966208:0@lo:104: 00000100:00100000:3.0:1788863629.994378:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323966336:0@lo:104: 00000100:00100000:3.0:1788863629.994387:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323966464:0@lo:104: 00000100:00100000:2.0:1788863629.994764:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863629.994931:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323966592:0@lo:103: 00000100:00100000:1.0:1788863629.995035:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863629.995131:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323966592 00000100:00100000:1.0:1788863629.995141:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323966592 00010000:00010000:1.0:1788863629.995186:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc0031000/0x744cd7666bbbaac6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaabf expref: 19 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863629.995230:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863629.995251:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759323966592:12345-0@lo:103: 00010000:00010000:1.0:1788863629.995270:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863629.995276:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc0031000/0x744cd7666bbbaac6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaabf expref: 19 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.995288:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc0031000/0x744cd7666bbbaac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbaabf expref: 19 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.995309:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0031000/0x744cd7666bbbaac6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbaabf expref: 19 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.995324:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863629.995361:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+18:3307:x1875759323966592:12345-0@lo:103: Request processed in 112us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863629.995370:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863629.995413:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323966592:0@lo:103: 00010000:00010000:0.0:1788863629.995493:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.995503:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbaa79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.995520:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788863629.995525:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.995533:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166a400 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:0.0:1788863629.995537:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbaa72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.995546:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbaa72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863629.995553:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbaa72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863629.995560:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788863629.995599:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.995606:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863629.996528:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788863629.997255:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa9c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997269:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc13a1a00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:1.0:1788863629.997274:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbaa9c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997286:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbaa9c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863629.997294:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbaa9c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863629.997301:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863629.997380:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa9c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997387:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863629.997408:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa9c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997416:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a1a00/0x744cd7666bbbaa95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa9c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997433:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863629.997437:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa3a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997444:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166a800 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:1.0:1788863629.997447:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbaa3a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997454:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbaa3a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863629.997460:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbaa3a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863629.997466:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863629.997480:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa3a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997485:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863629.997491:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa3a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997508:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a800/0x744cd7666bbbaa33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa3a expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997521:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863629.997525:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa10 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997531:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166ac00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:1.0:1788863629.997534:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbaa10 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997542:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbaa10 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863629.997549:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbaa10 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863629.997554:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863629.997570:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa10 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863629.997576:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788863629.998096:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323965440:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788863629.998113:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8436:1875759323965568:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788863629.998177:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.998791:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.998804:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc166a400/0x744cd7666bbbaa6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.998822:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863629.998825:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863629.998827:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863629.998847:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323966976:0@lo:103: 00000100:00100000:0.0:1788863629.998962:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.999044:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863629.999051:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323967104:0@lo:103: 00000100:00100000:0.0:1788863629.999075:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.999176:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323967232:0@lo:103: 00000100:00100000:0.0:1788863629.999203:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.999224:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863629.999231:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323966848:0@lo:103: 00000100:00100000:0.0:1788863629.999254:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863629.999294:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323966976 00000100:00100000:0.0:1788863629.999304:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323966976 00010000:00010000:0.0:1788863629.999362:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbaa9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa95 expref: 18 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863629.999391:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323967104 00000100:00100000:0.0:1788863629.999394:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323967104 00010000:00010000:0.0:1788863629.999408:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc0030400/0x744cd7666bbbaa3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa33 expref: 19 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863629.999418:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323967232 00000100:00100000:0.0:1788863629.999440:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323967232 00010000:00010000:0.0:1788863629.999455:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bffc17800/0x744cd7666bbbaa10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa09 expref: 20 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863629.999467:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323966848 00000100:00100000:0.0:1788863629.999469:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323966848 00010000:00010000:0.0:1788863629.999480:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc0031c00/0x744cd7666bbbaa72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa6b expref: 21 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863629.999495:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788863629.999507:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+21:3306:x1875759323966976:12345-0@lo:103: 00010000:00010000:0.0:1788863629.999530:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863629.999537:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbaa9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa95 expref: 21 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.999550:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbaa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbaa95 expref: 21 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.999575:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbaa9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbaa95 expref: 21 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.999593:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863629.999636:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+20:3306:x1875759323966976:12345-0@lo:103: Request processed in 131us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.999644:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788863629.999685:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863629.999691:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323967104:12345-0@lo:103: 00010000:00010000:0.0:1788863629.999699:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863629.999703:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc0030400/0x744cd7666bbbaa3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa33 expref: 19 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.999723:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc0030400/0x744cd7666bbbaa3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbaa33 expref: 19 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.999733:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0030400/0x744cd7666bbbaa3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbaa33 expref: 19 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.999754:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863629.999778:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+18:3306:x1875759323967104:12345-0@lo:103: Request processed in 87us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.999784:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863629.999799:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863629.999804:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+17:3308:x1875759323967232:12345-0@lo:103: 00010000:00010000:0.0:1788863629.999812:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863629.999816:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bffc17800/0x744cd7666bbbaa10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa09 expref: 17 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.999824:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bffc17800/0x744cd7666bbbaa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbaa09 expref: 17 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.999835:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bffc17800/0x744cd7666bbbaa10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbaa09 expref: 17 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.999846:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863629.999898:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+16:3308:x1875759323967232:12345-0@lo:103: Request processed in 94us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863629.999904:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863629.999917:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863629.999923:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+15:3308:x1875759323966848:12345-0@lo:103: 00010000:00010000:0.0:1788863629.999937:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863629.999942:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc0031c00/0x744cd7666bbbaa72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa6b expref: 15 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.999951:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc0031c00/0x744cd7666bbbaa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbaa6b expref: 15 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.999962:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0031c00/0x744cd7666bbbaa72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbaa6b expref: 15 pid: 5835 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863629.999972:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863629.999994:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+14:3308:x1875759323966848:12345-0@lo:103: Request processed in 71us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863630.000000:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863630.000044:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323967104:0@lo:103: 00000100:00100000:0.0:1788863630.000053:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323966976:0@lo:103: 00000100:00100000:0.0:1788863630.000087:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323966848:0@lo:103: 00000100:00100000:0.0:1788863630.000095:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323967232:0@lo:103: 00000100:00100000:3.0:1788863630.000728:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323966720:0@lo:103: 00000100:00100000:3.0:1788863630.000789:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863630.001054:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863630.001132:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863630.001135:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863630.001795:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323966720 00000100:00100000:0.0:1788863630.001809:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323966720 00010000:00010000:0.0:1788863630.001877:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc13a0e00/0x744cd7666bbbaa80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa79 expref: 14 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863630.001920:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788863630.001931:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+14:3309:x1875759323966720:12345-0@lo:103: 00010000:00010000:0.0:1788863630.001948:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863630.001955:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc13a0e00/0x744cd7666bbbaa80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa79 expref: 14 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863630.001983:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc13a0e00/0x744cd7666bbbaa80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbaa79 expref: 14 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863630.002006:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc13a0e00/0x744cd7666bbbaa80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbaa79 expref: 14 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863630.002095:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863630.002188:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+13:3309:x1875759323966720:12345-0@lo:103: Request processed in 259us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863630.002195:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788863630.002258:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323966720:0@lo:103: 00010000:00010000:3.0:1788863630.002954:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa64 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863630.002969:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166b600 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863630.002975:0:8442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbaa64 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863630.002985:0:8442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbaa64 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863630.002993:0:8442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbaa64 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863630.003010:0:8442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788863630.003071:0:8442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa64 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863630.003110:0:8442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863630.003132:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa64 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863630.003140:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc166b600/0x744cd7666bbbaa5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa64 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863630.003161:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863630.003164:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863630.003165:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863630.003329:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863630.003520:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323967360:0@lo:103: 00000100:00100000:0.0:1788863630.003596:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863630.004444:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323967360 00000100:00100000:3.0:1788863630.004461:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323967360 00010000:00010000:3.0:1788863630.004515:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbbaa64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa5d expref: 13 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863630.004559:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788863630.004574:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2886c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+13:3308:x1875759323967360:12345-0@lo:103: 00010000:00010000:3.0:1788863630.004598:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863630.004605:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbbaa64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa5d expref: 13 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863630.004618:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbbaa64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbaa5d expref: 13 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863630.004640:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0031400/0x744cd7666bbbaa64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbaa5d expref: 13 pid: 5832 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863630.004794:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863630.004896:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2886c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+12:3308:x1875759323967360:12345-0@lo:103: Request processed in 327us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863630.004925:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863630.005210:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323967360:0@lo:103: 00010000:00010000:1.0:1788863630.005603:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa10 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.005615:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ac00/0x744cd7666bbbaa09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa10 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.005644:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863630.005733:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863630.005736:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863630.007371:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863630.007500:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298777088 00000100:00100000:2.0:1788863630.007518:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298777088 00010000:00010000:2.0:1788863630.007587:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaadb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d35 expref: 10 pid: 5832 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863630.007757:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:2.0:1788863630.007772:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2351:x1875759298777088:12345-192.168.204.51@tcp:103: 00010000:00010000:2.0:1788863630.007796:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863630.007805:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaadb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d35 expref: 10 pid: 5832 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863630.007823:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaadb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d35 expref: 10 pid: 5832 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863630.007892:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc13a1400/0x744cd7666bbbaadb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d35 expref: 10 pid: 5832 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863630.007916:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863630.008035:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:2351:x1875759298777088:12345-192.168.204.51@tcp:103: Request processed in 265us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863630.008043:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1788863630.016043:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863630.016892:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298777216 00000100:00100000:1.0:1788863630.016909:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298777216 00010000:00010000:1.0:1788863630.017064:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc13a1e00/0x744cd7666bbbaad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d2e expref: 9 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863630.017124:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1788863630.017137:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:2350:x1875759298777216:12345-192.168.204.51@tcp:103: 00010000:00010000:1.0:1788863630.017161:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863630.017168:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc13a1e00/0x744cd7666bbbaad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d2e expref: 9 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.017184:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc13a1e00/0x744cd7666bbbaad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d2e expref: 9 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.017210:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc13a1e00/0x744cd7666bbbaad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d2e expref: 9 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.017233:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.017244:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.017268:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.017278:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.017315:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.017322:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.017331:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863630.017338:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.017349:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.017377:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863630.017394:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863630.017618:0:8436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863630.017630:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863630.017637:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab13 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863630.019442:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+8:2350:x1875759298777216:12345-192.168.204.51@tcp:103: Request processed in 2294us (3881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863630.019460:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00010000:00010000:1.0:1788863630.294481:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863630.654067:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863630.655531:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863630.656894:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298777344 00000100:00100000:2.0:1788863630.656922:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298777344 00000100:00100000:2.0:1788863630.657146:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:2.0:1788863630.657165:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298777344:12345-192.168.204.51@tcp:400: 00000100:00100000:2.0:1788863630.657324:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298777344:12345-192.168.204.51@tcp:400: Request processed in 166us (3281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863630.657333:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1788863630.657590:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298777472 00000100:00100000:3.0:1788863630.657598:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298777472 00000100:00100000:3.0:1788863630.660326:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788863630.660358:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2353:x1875759298777472:12345-192.168.204.51@tcp:400: 00000100:00100000:3.0:1788863630.660518:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2353:x1875759298777472:12345-192.168.204.51@tcp:400: Request processed in 174us (5070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863630.660529:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1788863630.663357:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863630.663480:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298777600 00000100:00100000:1.0:1788863630.663493:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298777600 00000100:00100000:1.0:1788863630.663763:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1788863630.663783:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2352:x1875759298777600:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1788863630.663922:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2352:x1875759298777600:12345-192.168.204.51@tcp:400: Request processed in 145us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863630.663951:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00080000:0.0:1788863630.665757:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863630.665778:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863630.665785:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788863631.318708:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863631.446471:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323967488:0@lo:13: 00000100:00100000:0.0:1788863631.446605:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863631.447152:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323967488 00000100:00100000:3.0:1788863631.447167:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323967488 00000100:00100000:3.0:1788863631.447283:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788863631.447296:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323967488:12345-0@lo:13: 00002000:00000024:3.0:1788863631.447352:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863631.447428:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323967488:12345-0@lo:13: Request processed in 135us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863631.447436:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788863631.448159:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788863631.449302:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bffdced80 x1875759323967488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863631.449344:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323967488:0@lo:13: 00000100:00100000:3.0:1788863631.871233:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863631.871369:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298777728 00000100:00100000:1.0:1788863631.871392:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298777728 00000100:00100000:1.0:1788863631.871496:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:1.0:1788863631.871509:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+8:5595:x1875759298777728:12345-192.168.204.51@tcp:101: 00010000:00010000:1.0:1788863631.871531:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863631.871558:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7bc00/0x744cd7666bbbab1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330d97 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863631.871592:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7bc00/0x744cd7666bbbab1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d97 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863631.871604:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7bc00/0x744cd7666bbbab1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d97 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863631.871614:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7bc00, rc 0) 00000100:00100000:1.0:1788863631.871716:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:5595:x1875759298777728:12345-192.168.204.51@tcp:101: Request processed in 210us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863631.871723:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:2.0:1788863631.876948:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863631.877097:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298777856 00000100:00100000:0.0:1788863631.877133:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298777856 00000100:00100000:0.0:1788863631.877265:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:0.0:1788863631.877280:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:5595:x1875759298777856:12345-192.168.204.51@tcp:501: 00000100:00100000:0.0:1788863631.877739:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:5595:x1875759298777856:12345-192.168.204.51@tcp:501: Request processed in 462us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863631.877748:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:2.0:1788863631.885622:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863631.886168:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298777984 00000100:00100000:0.0:1788863631.886185:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298777984 00000100:00100000:0.0:1788863631.886272:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:0.0:1788863631.886285:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:5595:x1875759298777984:12345-192.168.204.51@tcp:503: 00000100:00100000:0.0:1788863631.886658:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:5595:x1875759298777984:12345-192.168.204.51@tcp:503: Request processed in 374us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863631.886669:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:3.0:1788863631.892061:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863631.892534:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298778112 00000100:00100000:1.0:1788863631.892551:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298778112 00000100:00100000:1.0:1788863631.892636:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:1.0:1788863631.892649:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:6066:x1875759298778112:12345-192.168.204.51@tcp:502: 00000100:00100000:1.0:1788863631.895807:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:6066:x1875759298778112:12345-192.168.204.51@tcp:502: Request processed in 3138us (3742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863631.895828:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:2.0:1788863631.903545:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863631.903758:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298778240 00000100:00100000:3.0:1788863631.903776:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298778240 00000100:00100000:3.0:1788863631.903972:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:3.0:1788863631.903986:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:6066:x1875759298778240:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788863631.904488:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:6066:x1875759298778240:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 503us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863631.904502:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:2.0:1788863631.911672:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863631.911845:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298778368 00000100:00100000:1.0:1788863631.911921:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298778368 00000100:00100000:1.0:1788863631.912004:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:1.0:1788863631.912016:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:5595:x1875759298778368:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863631.912042:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863631.912095:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbab21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330d9e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863631.912141:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbab21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d9e expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863631.912157:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbab21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d9e expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863631.912799:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a400, rc 0) 00000100:00100000:1.0:1788863631.912952:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5595:x1875759298778368:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 924us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863631.912962:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:1.0:1788863631.917387:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863631.917710:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298778496 00000100:00100000:3.0:1788863631.917727:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298778496 00000100:00100000:3.0:1788863631.917893:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:3.0:1788863631.917907:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5595:x1875759298778496:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863631.918619:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5595:x1875759298778496:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 709us (1539us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788863631.918632:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 137 10000000:01000000:0.0:1788863631.958016:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788863631.958028:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e8bd2b49800 from 39 10000000:01000000:0.0:1788863631.958037:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788863631.958136:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863631.958151:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863631.958175:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863631.958213:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323967616:0@lo:101: 00000100:00100000:0.0:1788863631.958811:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863631.959033:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf3c2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788863631.959800:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323967616 00000100:00100000:3.0:1788863631.959817:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323967616 00000100:00100000:2.0:1788863631.963634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788863631.963673:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+12:5838:x1875759323967616:12345-0@lo:101: 00010000:00010000:2.0:1788863631.963711:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863631.963742:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8c021c6800/0x744cd7666bbbab2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbab28 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863631.963789:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8c021c6800/0x744cd7666bbbab2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbab28 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863631.963830:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8c021c6800/0x744cd7666bbbab2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbab28 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863631.963842:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8c021c6800, rc 0) 00000100:00100000:2.0:1788863631.964015:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323967616:12345-0@lo:101: Request processed in 355us (5208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863631.964023:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788863631.964189:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323967616:0@lo:101: 00010000:00010000:3.0:1788863631.964225:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863631.964236:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863631.964346:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323967744:0@lo:501: 00000100:00100000:3.0:1788863631.964392:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863631.973794:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863631.977478:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323967744 00000100:00100000:0.0:1788863631.977511:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323967744 00000100:00100000:0.0:1788863631.977649:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788863631.977695:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323967744:12345-0@lo:501: 00000100:00100000:0.0:1788863631.978617:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323967744:12345-0@lo:501: Request processed in 922us (14218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863631.978630:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788863631.981465:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323967744:0@lo:501: 00000100:00100000:2.0:1788863631.983557:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323967872:0@lo:503: 00000100:00100000:2.0:1788863631.983837:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863631.983922:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc01a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863631.984068:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323967872 00000100:00100000:0.0:1788863631.984080:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323967872 00000100:00100000:0.0:1788863631.984173:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788863631.984187:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323967872:12345-0@lo:503: 00000100:00100000:0.0:1788863631.984492:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323967872:12345-0@lo:503: Request processed in 307us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863631.984503:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788863631.985372:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323967872:0@lo:503: 00000100:00100000:0.0:1788863631.987213:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8456:1875759323968000:0@lo:502: 00000100:00100000:0.0:1788863631.987376:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863631.987443:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf3c29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863631.987624:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323968000 00000100:00100000:1.0:1788863631.987651:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323968000 00000100:00100000:1.0:1788863631.987742:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788863631.987755:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:8456:x1875759323968000:12345-0@lo:502: 00000100:00100000:1.0:1788863631.988748:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+13:8456:x1875759323968000:12345-0@lo:502: Request processed in 986us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863631.988762:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788863631.989886:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8456:1875759323968000:0@lo:502: 00000100:00100000:3.0:1788863631.990032:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8456:1875759323968128:0@lo:502: 00000100:00100000:3.0:1788863631.990288:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863631.990353:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863631.990677:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323968128 00000100:00100000:1.0:1788863631.990693:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323968128 00000100:00100000:1.0:1788863631.990792:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788863631.990818:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:8456:x1875759323968128:12345-0@lo:502: 00000100:00100000:1.0:1788863631.992285:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+13:8456:x1875759323968128:12345-0@lo:502: Request processed in 1458us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863631.992302:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788863631.996994:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8456:1875759323968128:0@lo:502: 00000040:00080000:3.0:1788863631.997125:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788863631.997620:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788863631.997657:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863631.997678:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863631.997709:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863631.997725:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788863631.997729:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788863631.997733:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788863631.997810:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863631.997821:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863631.997900:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863631.997933:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323968256:0@lo:101: 00000100:00100000:2.0:1788863631.998046:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863631.998118:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc01a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863631.999441:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323968256 00000100:00100000:0.0:1788863631.999462:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323968256 00000100:00100000:0.0:1788863631.999554:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788863631.999569:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+13:5838:x1875759323968256:12345-0@lo:101: 00010000:00010000:0.0:1788863631.999596:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863631.999623:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbab3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbab36 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863631.999680:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbab3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbab36 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863631.999695:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbab3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbab36 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863631.999739:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030800, rc 0) 00000100:00100000:0.0:1788863631.999910:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+14:5838:x1875759323968256:12345-0@lo:101: Request processed in 343us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863631.999920:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788863632.000544:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323968256:0@lo:101: 00010000:00010000:2.0:1788863632.000571:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863632.000585:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863632.000731:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323968384:0@lo:501: 00000100:00100000:2.0:1788863632.000802:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.000899:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc01a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863632.001565:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323968384 00000100:00100000:1.0:1788863632.001576:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323968384 00000100:00100000:1.0:1788863632.001640:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788863632.001650:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+14:5838:x1875759323968384:12345-0@lo:501: 00000100:00100000:1.0:1788863632.003544:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+14:5838:x1875759323968384:12345-0@lo:501: Request processed in 1876us (2724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.003567:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788863632.004263:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323968384:0@lo:501: 00000100:00100000:2.0:1788863632.004339:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323968512:0@lo:503: 00000100:00100000:2.0:1788863632.004421:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.004465:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc01a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863632.004707:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323968512 00000100:00100000:3.0:1788863632.004719:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323968512 00000100:00100000:3.0:1788863632.004781:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788863632.004794:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+14:5838:x1875759323968512:12345-0@lo:503: 00000100:00100000:3.0:1788863632.005150:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+14:5838:x1875759323968512:12345-0@lo:503: Request processed in 357us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.005159:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788863632.005714:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323968512:0@lo:503: 00000100:00100000:1.0:1788863632.007564:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8457:1875759323968640:0@lo:502: 00000100:00100000:1.0:1788863632.007811:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863632.007909:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863632.008058:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323968640 00000100:00100000:2.0:1788863632.008070:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323968640 00000100:00100000:2.0:1788863632.008142:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788863632.008154:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+14:8457:x1875759323968640:12345-0@lo:502: 00000100:00100000:2.0:1788863632.008509:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+14:8457:x1875759323968640:12345-0@lo:502: Request processed in 356us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.008519:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788863632.009008:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8457:1875759323968640:0@lo:502: 00000020:01000000:0.0:1788863632.009071:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863632.009521:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863632.009526:0:8457:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788863632.009540:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788863632.009609:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8457:1875759323968768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863632.009737:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863632.009799:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf3c2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863632.010900:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323968768 00000100:00100000:3.0:1788863632.010922:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323968768 00000100:00100000:3.0:1788863632.011028:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788863632.011040:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+14:8457:x1875759323968768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863632.012809:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+14:8457:x1875759323968768:12345-0@lo:502:llog_process_th.0 Request processed in 1755us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.012829:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788863632.013386:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8457:1875759323968768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788863632.013448:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863632.013461:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863632.013464:0:8457:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788863632.013471:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788863632.013836:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788863632.013916:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788863632.013937:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863632.013955:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863632.013972:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788863632.013976:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e8bde7ad800 from 39 10000000:01000000:2.0:1788863632.013980:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788863632.014039:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863632.014060:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863632.014072:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863632.014257:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323968896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788863632.014352:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.014412:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc01900 going to sleep for 11 seconds 00000100:00100000:1.0:1788863632.014777:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323968896 00000100:00100000:1.0:1788863632.014789:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323968896 00000100:00100000:1.0:1788863632.015113:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788863632.015128:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+14:5838:x1875759323968896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863632.015155:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863632.015184:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7b000/0x744cd7666bbbab4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbab44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.015233:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7b000/0x744cd7666bbbab4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbab44 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.015272:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7b000/0x744cd7666bbbab4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbab44 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.015284:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b000, rc 0) 00000100:00100000:1.0:1788863632.015359:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323968896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.015369:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788863632.015533:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323968896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863632.015558:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863632.015569:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863632.015684:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323969024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863632.015750:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863632.024333:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf3c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863632.027034:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323969024 00000100:00100000:2.0:1788863632.027256:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323969024 00000100:00100000:2.0:1788863632.027369:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788863632.027381:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323969024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863632.030829:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323969024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3432us (15059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.030886:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788863632.031534:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323969024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863632.031623:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323969152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863632.031720:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863632.031830:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf3c2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863632.032278:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323969152 00000100:00100000:1.0:1788863632.032292:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323969152 00000100:00100000:1.0:1788863632.032409:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788863632.032420:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323969152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863632.032813:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323969152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 391us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.032823:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788863632.033636:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323969152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863632.035490:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8458:1875759323969280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863632.035619:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.035688:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc019c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863632.035790:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323969280 00000100:00100000:1.0:1788863632.035803:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323969280 00000100:00100000:1.0:1788863632.035911:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788863632.035924:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+15:8458:x1875759323969280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863632.038416:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+15:8458:x1875759323969280:12345-0@lo:502:llog_process_th.0 Request processed in 2472us (2776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.038443:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788863632.039166:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8458:1875759323969280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863632.039307:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8458:1875759323969408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863632.039419:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.039459:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc019c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863632.039970:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323969408 00000100:00100000:1.0:1788863632.039984:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323969408 00000100:00100000:1.0:1788863632.040070:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788863632.040091:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+15:8458:x1875759323969408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863632.040558:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+15:8458:x1875759323969408:12345-0@lo:502:llog_process_th.0 Request processed in 477us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.040569:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788863632.040798:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8458:1875759323969408:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788863632.040846:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788863632.041362:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788863632.041391:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788863632.041406:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.041421:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863632.041434:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788863632.041438:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788863632.041442:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788863632.041497:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.041506:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.041517:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863632.041550:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323969536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788863632.041620:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863632.041737:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863632.044521:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323969536 00000100:00100000:3.0:1788863632.044553:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323969536 00000100:00100000:3.0:1788863632.044719:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788863632.044735:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+15:5838:x1875759323969536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863632.044765:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863632.044818:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bffc16800/0x744cd7666bbbab59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbab52 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.045452:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc16800/0x744cd7666bbbab59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbab52 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.045473:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bffc16800/0x744cd7666bbbab59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbab52 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.045484:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16800, rc 0) 00000100:00100000:3.0:1788863632.045668:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323969536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 936us (4046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.045676:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788863632.046434:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323969536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863632.046479:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.046521:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863632.046675:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323969664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863632.046767:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863632.046902:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863632.047326:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323969664 00000100:00100000:0.0:1788863632.047336:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323969664 00000100:00100000:0.0:1788863632.047434:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788863632.047447:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323969664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863632.047890:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323969664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 443us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.047900:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788863632.048022:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323969664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863632.048401:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323969792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863632.048459:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863632.048651:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863632.048733:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323969792 00000100:00100000:3.0:1788863632.048741:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323969792 00000100:00100000:3.0:1788863632.048780:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788863632.048787:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323969792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863632.049319:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323969792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 529us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.049327:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788863632.049804:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323969792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863632.051329:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8459:1875759323969920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863632.051458:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863632.051515:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863632.051593:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323969920 00000100:00100000:3.0:1788863632.051605:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323969920 00000100:00100000:3.0:1788863632.051671:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788863632.051684:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:8459:x1875759323969920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863632.052418:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:8459:x1875759323969920:12345-0@lo:502:llog_process_th.0 Request processed in 732us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.052430:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788863632.052678:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8459:1875759323969920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788863632.052739:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863632.052756:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863632.052760:0:8459:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788863632.052769:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788863632.052824:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8459:1875759323970048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863632.052913:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863632.052959:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863632.053367:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323970048 00000100:00100000:3.0:1788863632.053387:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323970048 00000100:00100000:3.0:1788863632.053433:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788863632.053442:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:8459:x1875759323970048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863632.053693:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:8459:x1875759323970048:12345-0@lo:502:llog_process_th.0 Request processed in 251us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.053714:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788863632.054315:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8459:1875759323970048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788863632.054361:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863632.054372:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863632.054375:0:8459:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788863632.054381:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788863632.054677:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788863632.054712:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788863632.054726:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863632.054739:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863632.054752:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788863632.054763:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e8bd56cb800 from 39 10000000:01000000:0.0:1788863632.054767:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788863632.054817:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863632.054827:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863632.054840:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863632.054904:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323970176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863632.055386:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863632.055470:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863632.055560:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323970176 00000100:00100000:2.0:1788863632.055570:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323970176 00000100:00100000:3.0:1788863632.055674:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788863632.055689:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323970176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863632.055720:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863632.055744:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbab60 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.055785:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbab60 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.055799:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbab60 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.055810:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16200, rc 0) 00000100:00100000:3.0:1788863632.056283:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323970176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 595us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863632.056291:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788863632.056372:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323970176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863632.056395:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863632.056406:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863632.056500:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323970304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863632.056540:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863632.056722:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863632.056767:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323970304 00000100:00100000:1.0:1788863632.056774:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323970304 00000100:00100000:1.0:1788863632.056812:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788863632.056821:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323970304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863632.057689:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323970304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 860us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.057709:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788863632.059522:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323970304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863632.059788:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323970432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863632.060442:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863632.060498:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788863632.060586:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323970432 00000100:00100000:0.0:1788863632.060599:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323970432 00000100:00100000:0.0:1788863632.060681:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788863632.060694:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323970432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863632.061100:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323970432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 398us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.061111:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788863632.061369:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323970432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863632.062590:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8460:1875759323970560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863632.062693:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863632.062761:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788863632.062895:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323970560 00000100:00100000:2.0:1788863632.062907:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323970560 00000100:00100000:2.0:1788863632.062975:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788863632.062987:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:8460:x1875759323970560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863632.063528:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:8460:x1875759323970560:12345-0@lo:502:llog_process_th.0 Request processed in 538us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.063539:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788863632.063967:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8460:1875759323970560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863632.064288:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8460:1875759323970688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863632.064346:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863632.064386:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2d66a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863632.064447:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323970688 00000100:00100000:2.0:1788863632.064456:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323970688 00000100:00100000:2.0:1788863632.064544:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788863632.064553:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:8460:x1875759323970688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863632.064804:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:8460:x1875759323970688:12345-0@lo:502:llog_process_th.0 Request processed in 252us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.064823:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788863632.069608:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8460:1875759323970688:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788863632.069728:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788863632.073356:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788863632.073419:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788863632.073437:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.073454:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863632.073499:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788863632.073503:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788863632.073505:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788863632.073573:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.073582:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.073600:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863632.073643:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323970816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863632.073778:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863632.074600:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863632.074786:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323970816 00000100:00100000:0.0:1788863632.074800:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323970816 00000100:00100000:1.0:1788863632.076603:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788863632.076646:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323970816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863632.076678:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863632.076721:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7b200/0x744cd7666bbbab75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbab6e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.076774:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7b200/0x744cd7666bbbab75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbab6e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.076816:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7b200/0x744cd7666bbbab75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbab6e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.076829:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b200, rc 0) 00000100:00100000:1.0:1788863632.077191:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323970816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 421us (3267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.077201:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788863632.079315:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323970816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863632.079361:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863632.079379:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863632.079509:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323970944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863632.079653:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863632.079806:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788863632.084440:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323970944 00000100:00100000:2.0:1788863632.084468:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323970944 00000100:00100000:2.0:1788863632.084631:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788863632.084647:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323970944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863632.085388:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323970944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 741us (5731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863632.085398:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788863632.085886:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323970944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863632.086010:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323971072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863632.086297:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863632.086926:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788863632.087480:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323971072 00000100:00100000:1.0:1788863632.087496:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323971072 00000100:00100000:1.0:1788863632.087583:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788863632.087595:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323971072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863632.088756:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323971072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1149us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.088772:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788863632.089399:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323971072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863632.090511:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8461:1875759323971200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863632.090630:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.090694:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbc013c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863632.090790:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323971200 00000100:00100000:1.0:1788863632.090805:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323971200 00000100:00100000:1.0:1788863632.090919:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788863632.091057:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:8461:x1875759323971200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863632.091601:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:8461:x1875759323971200:12345-0@lo:502:llog_process_th.0 Request processed in 670us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.091610:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788863632.091910:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8461:1875759323971200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788863632.092284:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863632.092303:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863632.092309:0:8461:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788863632.092318:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788863632.092376:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8461:1875759323971328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863632.092449:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863632.092497:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8be6596180 going to sleep for 11 seconds 00000100:00100000:0.0:1788863632.092676:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323971328 00000100:00100000:0.0:1788863632.092687:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323971328 00000100:00100000:0.0:1788863632.092776:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788863632.092796:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:8461:x1875759323971328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863632.094844:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:8461:x1875759323971328:12345-0@lo:502:llog_process_th.0 Request processed in 2028us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863632.094983:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788863632.095635:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8461:1875759323971328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788863632.095707:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863632.095719:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863632.095722:0:8461:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788863632.095728:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788863632.096321:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788863632.096358:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788863632.096374:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.096390:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863632.096404:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788863632.096408:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8bc84bb380 from 1 10000000:01000000:3.0:1788863632.096411:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788863632.096471:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16600/0x744cd7666bbbab7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.096505:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16600/0x744cd7666bbbab7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.096518:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16600/0x744cd7666bbbab7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863632.096550:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323971456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863632.096638:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863632.096692:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788863632.096774:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323971456 00000100:00100000:1.0:1788863632.096785:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323971456 00000100:00100000:1.0:1788863632.096872:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788863632.096885:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323971456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863632.096913:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863632.096930:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbab83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbab7c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.096969:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbab83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbab7c expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.096981:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbab83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbab7c expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863632.096991:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7ae00, rc 0) 00000100:00100000:1.0:1788863632.097053:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323971456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863632.097060:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788863632.097350:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323971456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863632.097368:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16600/0x744cd7666bbbab7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab83 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.097379:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16600/0x744cd7666bbbab7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab83 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863632.097448:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323971584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863632.097477:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863632.097511:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863632.097658:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323971584 00000100:00100000:2.0:1788863632.097664:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323971584 00000100:00100000:2.0:1788863632.097729:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788863632.097738:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323971584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863632.098315:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323971584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 575us (834us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863632.098325:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788863632.098539:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323971584:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788863632.098575:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788863632.098585:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16600/0x744cd7666bbbab7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab83 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.098596:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16600/0x744cd7666bbbab7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab83 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863632.349301:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863633.367964:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788863633.398679:0:8498:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe84641720 20000000:00000080:2.0:1788863633.398711:0:8498:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8bd00a2c00 uarg=0000000000000000 20000000:01000000:2.0:1788863633.398874:0:8498:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788863633.398884:0:8498:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788863633.398893:0:8498:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788863633.401557:0:8499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788863633.402168:0:8498:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788863633.418030:0:8498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788863633.418142:0:8498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788863633.418227:0:8498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788863633.418255:0:8498:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788863633.418288:0:8498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.418316:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbba8ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba8f8 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.418339:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba961 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbba95a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.418346:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbbaa2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbaa25 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.418357:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc13a1800/0x744cd7666bbbaae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d66 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.418366:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.418426:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc13a1800/0x744cd7666bbbaae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d66 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.419046:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bc13a1800/0x744cd7666bbbaae9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d66 expref: 9 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863633.419070:0:8498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1875759323971712:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788863633.419285:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbbaa2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbaa25 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.419295:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbbaa2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbaa25 expref: 18 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863633.419305:0:8498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1875759323971840:0@lo:104: 00000100:00100000:3.0:1788863633.419973:0:8498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863633.420169:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba95a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.420180:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba95a expref: 18 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863633.420192:0:8498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff747480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1875759323971968:0@lo:104: 00000100:00100000:3.0:1788863633.420229:0:8498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863633.421752:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbba8ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbba8f8 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.421775:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbba8ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbba8f8 expref: 18 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863633.421791:0:8498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1875759323972096:0@lo:104: 00000100:00100000:3.0:1788863633.421939:0:8498:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc96563c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863633.422063:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788863633.422099:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863633.422118:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323971840 00000100:00100000:0.0:1788863633.422128:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323971840 00000100:00100000:0.0:1788863633.422192:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323971968 00000100:00100000:0.0:1788863633.422196:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323971968 00000100:00100000:0.0:1788863633.422206:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323972096 00000100:00100000:0.0:1788863633.422208:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323972096 00000100:00100000:0.0:1788863633.422229:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863633.422239:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+5:8498:x1875759323971840:12345-0@lo:104: 00010000:00010000:0.0:1788863633.422257:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa2c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.422541:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788863633.422550:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+5:8498:x1875759323971840:12345-0@lo:104: Request processed in 311us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863633.422558:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863633.422584:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788863633.422591:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+4:8498:x1875759323971968:12345-0@lo:104: 00010000:00010000:0.0:1788863633.422601:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba961 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.422650:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788863633.422656:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+4:8498:x1875759323971968:12345-0@lo:104: Request processed in 66us (2426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863633.422709:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788863633.422750:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788863633.422756:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+3:8498:x1875759323972096:12345-0@lo:104: 00010000:00010000:0.0:1788863633.422764:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6e00/0x744cd7666bbba8f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba8ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.422808:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788863633.422813:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eff03fbe-e653-4192-b926-0416f2048378+3:8498:x1875759323972096:12345-0@lo:104: Request processed in 58us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863633.422819:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788863633.422992:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788863633.423000:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaa2c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423008:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166ae00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:0.0:1788863633.423012:0:8442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbaa2c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423022:0:8442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbaa2c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863633.423030:0:8442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbaa2c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863633.423037:0:8442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788863633.423087:0:8442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa2c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423094:0:8442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863633.423130:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa2c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423138:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc166ae00/0x744cd7666bbbaa25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaa2c expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423154:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788863633.423158:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba961 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423163:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166bc00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:0.0:1788863633.423166:0:8442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba961 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423173:0:8442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba961 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863633.423180:0:8442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba961 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863633.423185:0:8442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788863633.423201:0:8442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba961 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423207:0:8442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863633.423225:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba961 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423232:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc166bc00/0x744cd7666bbba95a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba961 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423243:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863633.423253:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6e00/0x744cd7666bbba8f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbba8ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423259:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8c021c6e00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:0.0:1788863633.423261:0:8442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6e00/0x744cd7666bbba8f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbba8ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423268:0:8442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6e00/0x744cd7666bbba8f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbba8ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863633.423274:0:8442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6e00/0x744cd7666bbba8f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbba8ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863633.423279:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788863633.423279:0:8442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788863633.423293:0:8442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6e00/0x744cd7666bbba8f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423299:0:8442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863633.423305:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6e00/0x744cd7666bbba8f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423311:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6e00/0x744cd7666bbba8f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbba8ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.423339:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863633.423341:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863633.423342:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863633.423361:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323972352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863633.423408:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863633.423487:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323972352 00000100:00100000:1.0:1788863633.423496:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323972352 00010000:00010000:1.0:1788863633.423530:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba961 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba95a expref: 19 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863633.423531:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863633.423537:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323972480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863633.423568:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863633.423570:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863633.423577:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323972352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863633.423594:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788863633.423599:0:5825:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788863633.423600:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba961 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba95a expref: 19 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863633.423608:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788863633.423613:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba95a expref: 19 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863633.423648:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863633.423706:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323972352:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863633.423714:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863633.423728:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323972480 00000100:00100000:1.0:1788863633.423731:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323972480 00010000:00010000:1.0:1788863633.423743:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbba8ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba8f8 expref: 19 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863633.423756:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788863633.423771:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323972480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863633.423779:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863633.423783:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbba8ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbba8f8 expref: 19 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863633.423791:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbba8ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbba8f8 expref: 19 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863633.423801:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863633.423821:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323972480:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863633.423827:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788863633.423927:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323972480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863633.423938:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323972352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863633.424081:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863633.424093:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323972224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863633.424123:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788863633.424158:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863633.424169:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323972224 00000100:00100000:0.0:1788863633.424173:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323972224 00010000:00010000:0.0:1788863633.424189:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbbaa2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa25 expref: 19 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863633.424209:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863633.424215:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323972224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788863633.424224:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863633.424228:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbbaa2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbaa25 expref: 19 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.424236:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbbaa2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbaa25 expref: 19 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.424247:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863633.424274:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323972224:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863633.424282:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863633.424317:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323972224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863633.426395:0:5823:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1788863633.428662:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc13a0a00/0x744cd7666bbbaa2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbaa25 expref: 18 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863633.429110:0:8498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1875759323971840:0@lo:104: 00010000:00010000:3.0:1788863633.429985:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0031e00/0x744cd7666bbba961 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba95a expref: 17 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863633.430025:0:8498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff747480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1875759323971968:0@lo:104: 00010000:00010000:3.0:1788863633.430043:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbba8ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbba8f8 expref: 16 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863633.430052:0:8498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1875759323972096:0@lo:104: 00000100:00100000:1.0:1788863633.431227:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863633.431311:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298778624 00000100:00100000:0.0:1788863633.431332:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298778624 00010000:00010000:0.0:1788863633.431387:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc13a1800/0x744cd7666bbbaae9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d66 expref: 10 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863633.431464:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:0.0:1788863633.431476:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2351:x1875759298778624:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863633.431497:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863633.431503:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc13a1800/0x744cd7666bbbaae9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d66 expref: 10 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.431517:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc13a1800/0x744cd7666bbbaae9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d66 expref: 10 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.431718:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.431729:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.431752:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.431761:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.431769:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.431777:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.431785:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16e00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863633.431791:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.431811:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.431822:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863633.431845:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863633.432131:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc13a1800/0x744cd7666bbbaae9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d66 expref: 10 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863633.432152:0:8498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1875759323971712:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863633.432161:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:2351:x1875759298778624:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 687us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863633.432172:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00010000:00010000:3.0:1788863633.432194:0:8498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.432313:0:8498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.432322:0:8498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863633.432329:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bffc16e00/0x744cd7666bbbab8a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863634.390673:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863634.518116:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788863634.518172:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323972736:0@lo:400:kworker.0 00000100:00100000:3.0:1788863634.518247:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323972992:0@lo:400:kworker.0 00000100:00100000:0.0:1788863634.518279:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863634.518293:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863634.518333:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323972608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863634.518354:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323973248:0@lo:400:kworker.0 00000100:00100000:0.0:1788863634.518369:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863634.518398:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759323972864:0@lo:400:kworker.0 00000100:00100000:1.0:1788863634.518409:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863634.518429:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863634.518454:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323973376:0@lo:400:kworker.0 00000100:00100000:0.0:1788863634.518644:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863634.518701:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323973120:0@lo:400:kworker.0 00000100:00100000:0.0:1788863634.518727:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863634.518763:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323972736 00000100:00100000:0.0:1788863634.518773:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323972736 00000100:00100000:0.0:1788863634.518832:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788863634.518841:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+16:3307:x1875759323972736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863634.518930:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+16:3307:x1875759323972736:12345-0@lo:400:kworker.0 Request processed in 90us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863634.518938:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788863634.518968:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323972992 00000100:00100000:0.0:1788863634.518972:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323972992 00000100:00100000:0.0:1788863634.519006:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323973248 00000100:00100000:0.0:1788863634.519009:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323973248 00000100:00100000:0.0:1788863634.519023:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323972864 00000100:00100000:0.0:1788863634.519026:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323972864 00000100:00100000:0.0:1788863634.519037:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788863634.519043:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323972992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863634.519075:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323972992:12345-0@lo:400:kworker.0 Request processed in 33us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863634.519081:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788863634.519092:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788863634.519099:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323973248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863634.519133:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323973248:12345-0@lo:400:kworker.0 Request processed in 35us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863634.519140:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788863634.519168:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788863634.519175:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759323972864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863634.519213:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759323972864:12345-0@lo:400:kworker.0 Request processed in 38us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863634.519221:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788863634.519247:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323972608 00000100:00100000:0.0:1788863634.519251:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323972608 00000100:00100000:0.0:1788863634.519279:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863634.519294:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323972608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788863634.519336:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863634.519373:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323972608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863634.519379:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788863634.520356:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323973120 00000100:00100000:0.0:1788863634.520356:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323973376 00000100:00100000:1.0:1788863634.520371:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323973120 00000100:00100000:0.0:1788863634.520371:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323973376 00000100:00100000:0.0:1788863634.520428:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788863634.520437:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323973120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863634.520985:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323973120:12345-0@lo:400:kworker.0 Request processed in 547us (2254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863634.522744:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323972992:0@lo:400:kworker.0 00000100:00080000:3.0:1788863634.522945:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863634.522951:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863634.522955:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863634.523431:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323973248:0@lo:400:kworker.0 00000100:00100000:3.0:1788863634.523536:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759323972864:0@lo:400:kworker.0 00000100:00100000:3.0:1788863634.523549:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323972736:0@lo:400:kworker.0 00010000:00080000:3.0:1788863634.523565:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd01a8a80 x1875759323972608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863634.523995:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323972608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863634.525290:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863634.525331:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788863634.525505:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff746680 x1875759323973120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863634.525524:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323973120:0@lo:400:kworker.0 00000100:00100000:1.0:1788863634.525615:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323973376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863634.525733:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323973376:12345-0@lo:400:kworker.0 Request processed in 128us (7088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863634.525740:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788863634.525903:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff744000 x1875759323973376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863634.525915:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323973376:0@lo:400:kworker.0 10000000:01000000:0.0:1788863634.709989:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863634.709999:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bd2b49800 from 4 10000000:01000000:0.0:1788863634.710004:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863634.710196:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863634.710212:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863634.710228:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863634.710265:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323973504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863634.710366:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863634.710441:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788863634.711147:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323973504 00000100:00100000:1.0:1788863634.711159:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323973504 00000100:00100000:1.0:1788863634.711211:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788863634.711220:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323973504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863634.711238:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863634.711255:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7b800/0x744cd7666bbbab98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbab91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863634.711283:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7b800/0x744cd7666bbbab98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbab91 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863634.711296:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7b800/0x744cd7666bbbab98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbab91 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863634.711305:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b800, rc 0) 00000100:00100000:1.0:1788863634.711366:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323973504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863634.711373:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788863634.711593:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323973504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863634.711611:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863634.711621:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863634.711715:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323973632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863634.711750:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863634.711787:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bf47b2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788863634.711946:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323973632 00000100:00100000:1.0:1788863634.711951:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323973632 00000100:00100000:1.0:1788863634.711993:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788863634.712000:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323973632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863634.713467:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323973632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1460us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863634.713479:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788863634.713602:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323973632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863634.713666:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323973760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863634.713712:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863634.713746:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788863634.713914:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323973760 00000100:00100000:1.0:1788863634.713920:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323973760 00000100:00100000:1.0:1788863634.713963:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788863634.713971:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323973760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863634.715047:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323973760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1065us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863634.715057:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788863634.723406:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323973760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863634.727473:0:8545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8545:1875759323973888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863634.727588:0:8545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863634.727655:0:8545:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863634.727709:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323973888 00000100:00100000:1.0:1788863634.727718:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323973888 00000100:00100000:1.0:1788863634.727775:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788863634.727784:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:8545:x1875759323973888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863634.728420:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:8545:x1875759323973888:12345-0@lo:502:llog_process_th.0 Request processed in 634us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863634.728429:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788863634.728542:0:8545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8545:1875759323973888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788863634.728572:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863634.728583:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863634.728585:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788863634.728593:0:8545:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8bd2b49800 00000020:00000080:0.0:1788863634.728595:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788863634.728687:0:8545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8545:1875759323974016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863634.728720:0:8545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863634.728734:0:8545:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863634.728925:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323974016 00000100:00100000:0.0:1788863634.728931:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323974016 00000100:00100000:0.0:1788863634.728958:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788863634.728965:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:8545:x1875759323974016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863634.729173:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:8545:x1875759323974016:12345-0@lo:502:llog_process_th.0 Request processed in 208us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863634.729180:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788863634.729226:0:8545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8545:1875759323974016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788863634.729245:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863634.729250:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863634.729252:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788863634.729256:0:8545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788863634.730987:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788863634.731027:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863634.731046:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863634.731060:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863634.731070:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863634.731073:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bde7ad800 from 4 10000000:01000000:0.0:1788863634.731076:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863634.731114:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863634.731122:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863634.731132:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863634.731156:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323974144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863634.731214:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863634.731258:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863634.732266:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323974144 00000100:00100000:3.0:1788863634.732276:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323974144 00000100:00100000:3.0:1788863634.732329:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788863634.732339:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323974144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863634.732354:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863634.732370:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbaba6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbab9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863634.732398:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbaba6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbab9f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863634.732410:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbaba6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbab9f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863634.732419:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17200, rc 0) 00000100:00100000:3.0:1788863634.732476:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323974144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863634.732492:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788863634.733159:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323974144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863634.733178:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaba6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863634.733194:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbaba6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863634.733262:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323974272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863634.733295:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863634.733328:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863634.736406:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323974272 00000100:00100000:3.0:1788863634.736421:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323974272 00000100:00100000:3.0:1788863634.736482:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788863634.736492:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323974272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863634.736810:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323974272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (3513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863634.736819:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788863634.737312:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323974272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863634.737376:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323974400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788863634.737429:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863634.737476:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788863634.739939:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323974400 00000100:00100000:3.0:1788863634.739955:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323974400 00000100:00100000:3.0:1788863634.740014:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788863634.740023:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323974400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863634.740285:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323974400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 262us (2856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863634.740293:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788863634.740364:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323974400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863634.740548:0:8548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8548:1875759323974528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863634.740592:0:8548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863634.740627:0:8548:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09780 going to sleep for 11 seconds 00000100:00100000:2.0:1788863634.740695:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323974528 00000100:00100000:2.0:1788863634.740700:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323974528 00000100:00100000:2.0:1788863634.740744:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788863634.740750:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:8548:x1875759323974528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863634.740914:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:8548:x1875759323974528:12345-0@lo:502:llog_process_th.0 Request processed in 163us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863634.740921:0:8548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8548:1875759323974528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863634.740921:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000020:01000000:3.0:1788863634.740943:0:8548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863634.740953:0:8548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863634.740955:0:8548:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788863634.740963:0:8548:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8bde7ad800 00000020:00000080:3.0:1788863634.740965:0:8548:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788863634.741104:0:8548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8548:1875759323974656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863634.741138:0:8548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863634.741157:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323974656 00000100:00100000:3.0:1788863634.741161:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323974656 00000100:00100000:3.0:1788863634.741183:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788863634.741188:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+18:8548:x1875759323974656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863634.741293:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+18:8548:x1875759323974656:12345-0@lo:502:llog_process_th.0 Request processed in 104us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863634.741300:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788863634.741331:0:8548:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863634.741342:0:8548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8548:1875759323974656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863634.741359:0:8548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863634.741363:0:8548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863634.741364:0:8548:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788863634.741367:0:8548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788863634.741425:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788863634.741448:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863634.741460:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaba6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863634.741472:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaba6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863634.741482:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788863634.741486:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bd56cb800 from 4 10000000:01000000:3.0:1788863634.741488:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788863634.741514:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863634.741531:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863634.741540:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863634.741553:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323974784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863634.741581:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863634.741601:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09780 going to sleep for 11 seconds 00000100:00100000:2.0:1788863634.741722:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323974784 00000100:00100000:2.0:1788863634.741727:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323974784 00000100:00100000:2.0:1788863634.741754:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788863634.741760:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323974784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863634.741770:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863634.741782:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbbabb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbabad expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863634.741802:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbbabb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbabad expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863634.741813:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbbabb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbabad expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863634.741821:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8c021c7e00, rc 0) 00000100:00100000:2.0:1788863634.742349:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323974784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 587us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863634.742355:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788863634.742948:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323974784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863634.742967:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbabb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863634.742977:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbabb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863634.743111:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323974912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863634.743148:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863634.743177:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09780 going to sleep for 11 seconds 00000100:00100000:2.0:1788863634.744914:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323974912 00000100:00100000:2.0:1788863634.744940:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323974912 00000100:00100000:2.0:1788863634.747327:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788863634.747352:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323974912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863634.747691:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323974912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (4542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863634.747705:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788863634.748181:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323974912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863634.748237:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323975040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863634.748282:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863634.748312:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863634.748327:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323975040 00000100:00100000:3.0:1788863634.748334:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323975040 00000100:00100000:3.0:1788863634.748375:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788863634.748381:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323975040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863634.748529:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323975040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863634.748536:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788863634.748567:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323975040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863634.752100:0:8552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8552:1875759323975168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863634.752207:0:8552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863634.752255:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323975168 00000100:00100000:3.0:1788863634.752263:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323975168 00000100:00100000:3.0:1788863634.752312:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788863634.752323:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:8552:x1875759323975168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863634.752577:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:8552:x1875759323975168:12345-0@lo:502:llog_process_th.0 Request processed in 256us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863634.752585:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788863634.752634:0:8552:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863634.752667:0:8552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8552:1875759323975168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863634.752701:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863634.752711:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863634.752715:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788863634.752721:0:8552:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8bd56cb800 00000020:00000080:3.0:1788863634.752723:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788863634.752803:0:8552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8552:1875759323975296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863634.752872:0:8552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863634.752895:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323975296 00000100:00100000:3.0:1788863634.752906:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323975296 00000100:00100000:3.0:1788863634.752932:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788863634.752939:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:8552:x1875759323975296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863634.753056:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:8552:x1875759323975296:12345-0@lo:502:llog_process_th.0 Request processed in 116us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863634.753062:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788863634.753096:0:8552:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8ac2f09780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863634.753109:0:8552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:8552:1875759323975296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863634.753126:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863634.753131:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863634.753132:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788863634.753136:0:8552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788863634.753181:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788863634.753198:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863634.753207:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbabb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863634.753217:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbabb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863635.414421:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863635.452697:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863635.452814:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298778752 00000100:00100000:0.0:1788863635.452824:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298778752 00000100:00100000:0.0:1788863635.452881:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:0.0:1788863635.452891:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:5595:x1875759298778752:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863635.452908:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863635.452927:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbabbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330da5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863635.452958:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbabbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330da5 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863635.452971:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbabbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330da5 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863635.452980:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030000, rc 0) 00000100:00100000:0.0:1788863635.453065:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5595:x1875759298778752:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 176us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863635.453073:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:3.0:1788863635.456183:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863635.456277:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298778880 00000100:00100000:0.0:1788863635.456293:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298778880 00000100:00100000:0.0:1788863635.456379:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:0.0:1788863635.456392:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5595:x1875759298778880:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863635.456770:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5595:x1875759298778880:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 380us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863635.456778:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:3.0:1788863635.458368:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863635.458826:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298779008 00000100:00100000:0.0:1788863635.458838:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298779008 00000100:00100000:0.0:1788863635.458964:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:0.0:1788863635.458974:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5595:x1875759298779008:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863635.459221:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:5595:x1875759298779008:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 248us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863635.459228:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:3.0:1788863635.468659:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863635.468899:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298779136 00000100:00100000:2.0:1788863635.468910:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298779136 00000100:00100000:2.0:1788863635.468970:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:2.0:1788863635.468985:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:6130:x1875759298779136:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788863635.469296:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:6130:x1875759298779136:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 314us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863635.469305:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:3.0:1788863635.475773:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863635.475949:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298779264 00000100:00100000:0.0:1788863635.475963:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298779264 00000100:00100000:0.0:1788863635.476040:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 190 00000100:00100000:0.0:1788863635.476051:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:6130:x1875759298779264:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863635.476473:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:6130:x1875759298779264:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 423us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863635.476482:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 190 00000100:00100000:2.0:1788863635.773972:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863635.774007:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863635.774026:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298779520 00000100:00100000:0.0:1788863635.774042:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298779520 00000100:00100000:0.0:1788863635.774113:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:0.0:1788863635.774123:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298779520:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863635.774202:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298779520:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 80us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863635.774220:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:2.0:1788863635.774584:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863635.774702:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298779648 00000100:00100000:0.0:1788863635.774708:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298779648 00000100:00100000:0.0:1788863635.774742:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:0.0:1788863635.774749:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5770000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298779648:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863635.774781:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5770000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298779648:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863635.774787:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00080000:0.0:1788863635.774976:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863635.774983:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863635.780897:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298779392 00000100:00100000:3.0:1788863635.780919:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298779392 00000100:00100000:3.0:1788863635.781154:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1788863635.781169:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298779392:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863635.781299:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298779392:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 134us (7290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863635.781310:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00080000:3.0:1788863635.781426:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788863636.438057:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863636.570623:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863636.570653:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323975424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863636.570744:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863636.570905:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323975424 00000100:00100000:1.0:1788863636.570933:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323975424 00000100:00100000:1.0:1788863636.571008:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788863636.571018:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323975424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863636.571056:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863636.571104:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323975424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863636.571112:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788863636.571235:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788863636.571270:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bffdcdc00 x1875759323975424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863636.571291:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323975424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788863637.468200:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863638.486288:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863639.510274:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863639.638432:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323975552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863639.638533:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863639.638809:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323975552 00000100:00100000:1.0:1788863639.638820:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323975552 00000100:00100000:1.0:1788863639.638916:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788863639.638929:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323975552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863639.638996:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863639.639047:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323975552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863639.639054:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788863639.639079:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323975680:0@lo:400:kworker.0 00000100:00100000:1.0:1788863639.639117:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863639.639146:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323976192:0@lo:400:kworker.0 00000100:00100000:1.0:1788863639.639173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863639.639196:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863639.639202:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323975808:0@lo:400:kworker.0 00000100:00100000:1.0:1788863639.639224:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788863639.639258:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863639.639294:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323975680 00000100:00100000:1.0:1788863639.639298:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323975680 00000100:00100000:1.0:1788863639.639327:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788863639.639350:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323975680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863639.639387:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323975680:12345-0@lo:400:kworker.0 Request processed in 38us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863639.639395:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788863639.639430:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323976192 00000100:00100000:1.0:1788863639.639434:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323976192 00000100:00100000:1.0:1788863639.639474:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323975808 00000100:00100000:1.0:1788863639.639478:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323975808 00000100:00100000:1.0:1788863639.639499:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788863639.639506:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323976192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863639.639540:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323976192:12345-0@lo:400:kworker.0 Request processed in 35us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863639.639560:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788863639.639576:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788863639.639583:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323975808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863639.639611:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323975808:12345-0@lo:400:kworker.0 Request processed in 29us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863639.639616:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788863639.639920:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323975936:0@lo:400:kworker.0 00000100:00100000:1.0:1788863639.639950:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863639.639972:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863639.639979:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323976064:0@lo:400:kworker.0 00000100:00100000:1.0:1788863639.640002:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788863639.640028:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863639.640188:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323975808:0@lo:400:kworker.0 00000100:00100000:1.0:1788863639.640197:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323975680:0@lo:400:kworker.0 00000100:00100000:1.0:1788863639.640319:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323975936 00000100:00100000:1.0:1788863639.640324:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323975936 00000100:00100000:1.0:1788863639.640356:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788863639.640364:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323975936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863639.640401:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323975936:12345-0@lo:400:kworker.0 Request processed in 39us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863639.640407:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788863639.640427:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863639.640443:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323975936:0@lo:400:kworker.0 00010000:00080000:1.0:1788863639.640485:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd01a8700 x1875759323975552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863639.640506:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323975552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863639.640533:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323976192:0@lo:400:kworker.0 00000100:00100000:0.0:1788863639.641238:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323976064 00000100:00100000:0.0:1788863639.641254:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323976064 00000100:00100000:0.0:1788863639.641333:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788863639.641344:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323976064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863639.641442:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323976064:12345-0@lo:400:kworker.0 Request processed in 100us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863639.641450:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788863639.641493:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bffdcd180 x1875759323976064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863639.641507:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323976064:0@lo:400:kworker.0 00000100:00080000:1.0:1788863639.642782:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788863640.534224:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863640.896268:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863640.896323:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863640.896368:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863640.896397:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863640.896425:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298780032 00000100:00100000:3.0:1788863640.896435:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298780032 00000100:00100000:3.0:1788863640.896492:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298780160 00000100:00100000:3.0:1788863640.896496:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298780160 00000100:00100000:3.0:1788863640.896516:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1788863640.896536:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298780032:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863640.896628:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298780032:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 103us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863640.896637:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1788863640.896655:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1788863640.896661:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298780160:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863640.896690:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298780160:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 29us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863640.896696:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1788863640.896715:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298779904 00000100:00100000:3.0:1788863640.896719:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298779904 00000100:00100000:3.0:1788863640.896749:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:3.0:1788863640.896755:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298779904:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863640.896801:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298779904:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 46us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863640.896808:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:1.0:1788863640.897039:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298779776 00000100:00100000:1.0:1788863640.897044:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298779776 00000100:00100000:1.0:1788863640.897101:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 192 00000100:00100000:1.0:1788863640.897108:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2351:x1875759298779776:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863640.897143:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2351:x1875759298779776:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 35us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863640.897150:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 192 00000100:00080000:1.0:1788863640.897178:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863640.897182:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863640.897184:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788863641.181739:0:8799:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788863641.558218:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863641.686082:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863641.686118:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323976320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863641.686192:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863641.686260:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323976320 00000100:00100000:1.0:1788863641.686267:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323976320 00000100:00100000:1.0:1788863641.686326:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788863641.686335:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323976320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863641.686378:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863641.686483:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323976320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863641.686490:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788863641.686523:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788863641.686559:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bffdced80 x1875759323976320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863641.686578:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323976320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788863642.582072:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863643.607126:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863644.630753:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863644.758721:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323976448:0@lo:400:kworker.0 00000100:00100000:0.0:1788863644.758813:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863644.758885:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759323976960:0@lo:400:kworker.0 00000100:00100000:0.0:1788863644.758913:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863644.758949:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323976576:0@lo:400:kworker.0 00000100:00100000:1.0:1788863644.758985:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323976704:0@lo:400:kworker.0 00000100:00100000:1.0:1788863644.759010:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323976832:0@lo:400:kworker.0 00000100:00100000:1.0:1788863644.759036:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863644.759077:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323976448 00000100:00100000:1.0:1788863644.759085:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323976448 00000100:00100000:1.0:1788863644.759143:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788863644.759152:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323976448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863644.759203:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323976448:12345-0@lo:400:kworker.0 Request processed in 52us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863644.759219:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788863644.759256:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323976832 00000100:00100000:1.0:1788863644.759260:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323976832 00000100:00100000:1.0:1788863644.759296:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788863644.759303:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323976832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863644.759350:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323976832:12345-0@lo:400:kworker.0 Request processed in 45us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863644.759360:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788863644.759391:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788863644.759436:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bffdcd180 x1875759323976832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863644.759471:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323976832:0@lo:400:kworker.0 00000100:00100000:0.0:1788863644.761042:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863644.761076:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323977216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863644.761199:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863644.761249:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323976960 00000100:00100000:0.0:1788863644.761257:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323976960 00000100:00100000:0.0:1788863644.761304:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323976704 00000100:00100000:0.0:1788863644.761307:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323976704 00000100:00100000:0.0:1788863644.761332:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788863644.761340:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759323976960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863644.761386:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759323976960:12345-0@lo:400:kworker.0 Request processed in 46us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863644.761392:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788863644.761407:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788863644.761427:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323976704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863644.761474:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323976704:12345-0@lo:400:kworker.0 Request processed in 47us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863644.761485:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788863644.761505:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323977216 00000100:00100000:0.0:1788863644.761508:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323977216 00000100:00100000:0.0:1788863644.761536:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863644.761542:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323977216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788863644.761574:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863644.761607:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323977216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863644.761612:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863644.761662:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323976704:0@lo:400:kworker.0 00010000:00080000:0.0:1788863644.761679:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd01a9f80 x1875759323977216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863644.761696:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323977216:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788863644.761739:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863644.761747:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863644.761766:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863644.761802:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323977088:0@lo:400:kworker.0 00000100:00100000:0.0:1788863644.761841:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863644.763610:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323976576 00000100:00100000:1.0:1788863644.763638:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323976576 00000100:00100000:1.0:1788863644.763745:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788863644.763764:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323976576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863644.763920:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323976576:12345-0@lo:400:kworker.0 Request processed in 163us (2154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863644.763929:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788863644.765009:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323976576:0@lo:400:kworker.0 00000100:00100000:0.0:1788863644.765068:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323977088 00000100:00100000:0.0:1788863644.765074:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323977088 00000100:00100000:0.0:1788863644.766914:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788863644.766941:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323977088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863644.767081:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323977088:12345-0@lo:400:kworker.0 Request processed in 153us (5239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863644.767089:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863644.768093:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759323976960:0@lo:400:kworker.0 00000100:00100000:1.0:1788863644.768221:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323976448:0@lo:400:kworker.0 00010000:00080000:0.0:1788863644.768344:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee337100 x1875759323977088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863644.768365:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323977088:0@lo:400:kworker.0 00010000:00010000:2.0:1788863645.655046:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863646.037040:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863646.037134:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863646.037176:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863646.037204:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863646.037233:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298780544 00000100:00100000:3.0:1788863646.037244:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298780544 00000100:00100000:3.0:1788863646.037343:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298780672 00000100:00100000:3.0:1788863646.037350:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298780672 00000100:00100000:3.0:1788863646.037388:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788863646.037405:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2349:x1875759298780544:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:3.0:1788863646.037493:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbaaf7 00000100:00080000:3.0:1788863646.037506:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8e8bf4f1e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788863646.037544:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788863646.038054:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+2:2349:x1875759298780544:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 654us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863646.038063:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788863646.038082:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1788863646.038090:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2349:x1875759298780672:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:3.0:1788863646.038106:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbaafe 00000100:00080000:3.0:1788863646.038113:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8e8bd2993800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788863646.038137:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788863646.038325:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+2:2349:x1875759298780672:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 234us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863646.038366:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1788863646.038412:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298780288 00000100:00100000:3.0:1788863646.038437:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298780288 00000100:00100000:3.0:1788863646.038490:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 194 00000100:00100000:3.0:1788863646.038497:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2351:x1875759298780288:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863646.038525:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2351:x1875759298780288:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 30us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863646.038532:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 194 00010000:00010000:3.0:1788863646.038758:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863646.040161:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298780416 00000100:00100000:0.0:1788863646.040176:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298780416 00000100:00100000:0.0:1788863646.040256:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:0.0:1788863646.040278:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298780416:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863646.040354:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298780416:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 87us (3176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863646.040361:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00080000:0.0:1788863646.040387:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863646.040391:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863646.040394:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788863646.040401:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863646.512058:0:9043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing yml_node 00010000:00010000:2.0:1788863646.679040:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863646.809290:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323977344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863646.809366:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863646.809480:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323977344 00000100:00100000:2.0:1788863646.809490:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323977344 00000100:00100000:2.0:1788863646.809577:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788863646.809589:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323977344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863646.809635:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788863646.815988:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863646.821474:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323977344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11878us (12097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863646.821489:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788863646.822486:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff744e00 x1875759323977344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863646.822519:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323977344:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863647.702087:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863648.726313:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788863649.453366:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000020:00000080:2.0:1788863649.453706:0:6708:0:(genops.c:885:class_export_put()) final put ffff8e8bf4f1d000/6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000020:00000080:3.0:1788863649.453790:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bf4f1d000/6fd3bcef-c680-4c25-aae1-ecd03903ad0a for lustre-OST0000 00000020:00000080:3.0:1788863649.453843:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bf4f1e800 for lustre-OST0000 00010000:00010000:0.0:1788863649.750055:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863649.878286:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323977600:0@lo:400:kworker.0 00000100:00100000:3.0:1788863649.878291:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323977728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863649.878382:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863649.878538:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323977472:0@lo:400:kworker.0 00000100:00100000:2.0:1788863649.878686:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759323977856:0@lo:400:kworker.0 00000100:00100000:3.0:1788863649.879763:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863649.879824:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323978240:0@lo:400:kworker.0 00000100:00100000:1.0:1788863649.880163:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863649.880278:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863649.880324:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323978240 00000100:00100000:3.0:1788863649.880333:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323978240 00000100:00100000:3.0:1788863649.880393:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788863649.880402:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323978240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863649.880453:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323978240:12345-0@lo:400:kworker.0 Request processed in 53us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863649.880461:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788863649.880480:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788863649.880526:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff745c00 x1875759323978240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863649.880539:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323978240:0@lo:400:kworker.0 00000100:00100000:3.0:1788863649.880579:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323977728 00000100:00100000:3.0:1788863649.880583:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323977728 00000100:00100000:3.0:1788863649.880607:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788863649.880617:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323977728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863649.880645:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863649.880679:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323977728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863649.880685:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788863649.880709:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd01aaa00 x1875759323977728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863665 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863649.880724:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323977728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863649.880755:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323977600 00000100:00100000:3.0:1788863649.880758:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323977600 00000100:00100000:3.0:1788863649.880784:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788863649.880791:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323977600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863649.880822:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323977600:12345-0@lo:400:kworker.0 Request processed in 32us (2441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863649.880828:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788863649.882953:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323977600:0@lo:400:kworker.0 00000100:00100000:0.0:1788863649.882986:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323978112:0@lo:400:kworker.0 00000100:00100000:0.0:1788863649.883048:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863649.883099:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323978112 00000100:00100000:0.0:1788863649.883105:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323978112 00000100:00100000:0.0:1788863649.883253:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788863649.883262:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323978112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863649.883467:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323978112:12345-0@lo:400:kworker.0 Request processed in 206us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863649.883475:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788863649.883503:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863649.883523:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323978112:0@lo:400:kworker.0 00000100:00100000:1.0:1788863649.884092:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323977984:0@lo:400:kworker.0 00000100:00100000:1.0:1788863649.884131:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863649.885490:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323977472 00000100:00100000:3.0:1788863649.885507:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323977472 00000100:00100000:3.0:1788863649.885652:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788863649.885664:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323977472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863649.885759:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323977472:12345-0@lo:400:kworker.0 Request processed in 98us (5596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863649.885780:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788863649.885980:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323977472:0@lo:400:kworker.0 00000100:00100000:2.0:1788863649.888663:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863649.888814:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323977856 00000100:00100000:3.0:1788863649.888825:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323977856 00000100:00100000:0.0:1788863649.889058:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323977984 00000100:00100000:0.0:1788863649.889064:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323977984 00000100:00080000:1.0:1788863649.889149:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863649.889155:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863649.889313:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788863649.889324:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759323977856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863649.889406:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759323977856:12345-0@lo:400:kworker.0 Request processed in 84us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863649.889412:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788863649.889438:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788863649.889445:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323977984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863649.889548:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323977984:12345-0@lo:400:kworker.0 Request processed in 102us (5416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863649.889554:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788863649.889674:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff746a00 x1875759323977984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863649.889690:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323977984:0@lo:400:kworker.0 00000100:00100000:2.0:1788863649.890496:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759323977856:0@lo:400:kworker.0 00000001:00100000:0.0:1788863650.461551:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000020:00000080:0.0:1788863650.461563:0:7637:0:(genops.c:885:class_export_put()) final put ffff8e8bd2994000/6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000020:00000080:1.0:1788863650.461644:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bd2994000/6fd3bcef-c680-4c25-aae1-ecd03903ad0a for lustre-OST0001 00000020:00000080:1.0:1788863650.461710:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bd2993800 for lustre-OST0001 00010000:00010000:2.0:1788863650.775029:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863651.136370:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863651.136443:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863651.136774:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298780928 00000100:00100000:3.0:1788863651.136786:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298780928 00000100:00100000:3.0:1788863651.136890:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:3.0:1788863651.136901:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298780928:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863651.136984:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298780928:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 84us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863651.136992:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:3.0:1788863651.137015:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298780800 00000100:00100000:3.0:1788863651.137019:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298780800 00000100:00100000:3.0:1788863651.137045:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00100000:3.0:1788863651.137051:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2353:x1875759298780800:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863651.137077:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2353:x1875759298780800:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863651.137099:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00080000:1.0:1788863651.137407:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788863651.218706:0:9238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:3.0:1788863651.806249:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863651.926023:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323978368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863651.926110:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863651.926218:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323978368 00000100:00100000:2.0:1788863651.926231:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323978368 00000100:00100000:2.0:1788863651.926301:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788863651.926321:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323978368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863651.926360:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863651.926414:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323978368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863651.926420:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788863651.926518:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788863651.926549:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bffdcf100 x1875759323978368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863651.926571:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323978368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788863652.822187:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863653.846090:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863654.143312:0:9336:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:1.0:1788863654.871272:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863654.998187:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323978496:0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.998308:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863654.998362:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759323979008:0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.998427:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863654.998473:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788863654.998481:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323978624:0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.998534:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863654.998555:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323979136:0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.998595:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863654.998626:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323978752:0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.998649:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863654.998668:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863654.998674:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323978880:0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.998693:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863654.998726:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323978496 00000100:00100000:3.0:1788863654.998735:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323978496 00000100:00100000:3.0:1788863654.998785:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788863654.998794:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323978496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.998880:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323978496:12345-0@lo:400:kworker.0 Request processed in 55us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863654.998889:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788863654.998924:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323979008 00000100:00100000:3.0:1788863654.998934:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323979008 00000100:00100000:3.0:1788863654.998971:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323978624 00000100:00100000:3.0:1788863654.998975:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323978624 00000100:00100000:3.0:1788863654.998991:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323978752 00000100:00100000:3.0:1788863654.998993:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323978752 00000100:00100000:3.0:1788863654.999007:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863654.999012:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759323979008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.999047:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759323979008:12345-0@lo:400:kworker.0 Request processed in 34us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863654.999053:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863654.999063:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788863654.999068:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323978624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.999090:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323978624:12345-0@lo:400:kworker.0 Request processed in 22us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863654.999095:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788863654.999104:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788863654.999110:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323978752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.999136:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323978752:12345-0@lo:400:kworker.0 Request processed in 27us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863654.999142:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788863654.999162:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323979136 00000100:00100000:3.0:1788863654.999166:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323979136 00000100:00100000:3.0:1788863654.999192:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323978880 00000100:00100000:3.0:1788863654.999194:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323978880 00000100:00100000:3.0:1788863654.999210:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788863654.999216:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323979136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.999259:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323979136:12345-0@lo:400:kworker.0 Request processed in 42us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863654.999275:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788863654.999286:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788863654.999292:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323978880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.999347:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323978880:12345-0@lo:400:kworker.0 Request processed in 55us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863654.999352:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788863654.999383:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863654.999388:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863654.999391:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788863654.999427:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff746a00 x1875759323978880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863654.999442:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323978880:0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.999456:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323978752:0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.999508:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323978624:0@lo:400:kworker.0 00010000:00080000:3.0:1788863654.999519:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff745880 x1875759323979136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863654.999528:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323979136:0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.999538:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323978496:0@lo:400:kworker.0 00000100:00100000:3.0:1788863654.999549:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759323979008:0@lo:400:kworker.0 00000100:00100000:3.0:1788863655.002765:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863655.002797:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323979264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863655.002898:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863655.007617:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323979264 00000100:00100000:1.0:1788863655.007635:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323979264 00000100:00100000:1.0:1788863655.007751:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788863655.007762:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323979264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863655.007800:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863655.007906:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323979264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (5008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863655.007914:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788863655.024959:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd01a8700 x1875759323979264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863655.024992:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323979264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788863655.894161:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863656.258431:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863656.258571:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863656.258660:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298781184 00000100:00100000:1.0:1788863656.258672:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298781184 00000100:00100000:1.0:1788863656.258761:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:1.0:1788863656.258774:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2352:x1875759298781184:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863656.259107:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2352:x1875759298781184:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 335us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863656.259117:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00080000:2.0:1788863656.259600:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863656.266933:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298781056 00000100:00100000:3.0:1788863656.266956:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298781056 00000100:00100000:0.0:1788863656.267215:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 198 00000100:00100000:0.0:1788863656.267240:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2352:x1875759298781056:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863656.267360:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2352:x1875759298781056:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 124us (8941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863656.267368:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 198 00010000:00010000:1.0:1788863656.920708:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863657.047076:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863657.047104:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323979392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863657.047177:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863657.047350:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323979392 00000100:00100000:1.0:1788863657.047359:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323979392 00000100:00100000:1.0:1788863657.047468:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788863657.047477:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323979392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863657.047522:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863657.047581:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323979392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863657.047589:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788863657.047629:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bffdcf100 x1875759323979392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863657.047659:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323979392:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788863657.047776:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788863657.459672:0:9434:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:0.0:1788863657.943948:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863658.966873:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788863659.500657:0:9482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 06:34:16 EDT 2026 00010000:00010000:3.0:1788863659.990294:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863660.118093:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863660.118116:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323979520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863660.118211:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863660.118391:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323979520 00000100:00100000:0.0:1788863660.118400:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323979520 00000100:00100000:0.0:1788863660.118490:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788863660.118501:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323979520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788863660.118552:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863660.118607:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323979520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863660.118615:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788863660.119327:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd01ab100 x1875759323979520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863660.119348:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323979520:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788863660.120445:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863660.120564:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863660.120581:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323979648:0@lo:400:kworker.0 00000100:00100000:3.0:1788863660.120646:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863660.120683:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323980032:0@lo:400:kworker.0 00000100:00100000:3.0:1788863660.120707:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863660.120724:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863660.120729:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759323980160:0@lo:400:kworker.0 00000100:00100000:3.0:1788863660.120749:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863660.120817:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323979776:0@lo:400:kworker.0 00000100:00100000:1.0:1788863660.120848:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863660.122460:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323980032 00000100:00100000:0.0:1788863660.122475:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323980032 00000100:00100000:0.0:1788863660.122555:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863660.122567:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323980032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863660.122669:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323980032:12345-0@lo:400:kworker.0 Request processed in 104us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863660.122676:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863660.122917:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323979648 00000100:00100000:0.0:1788863660.122923:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323979648 00000100:00100000:0.0:1788863660.122951:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788863660.122960:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323979648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863660.122992:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323979648:12345-0@lo:400:kworker.0 Request processed in 35us (2348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863660.122998:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788863660.123035:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759323979904:0@lo:400:kworker.0 00010000:00080000:3.0:1788863660.124381:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd01ab100 x1875759323980032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863660.124402:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323980032:0@lo:400:kworker.0 00000100:00100000:3.0:1788863660.124417:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323979648:0@lo:400:kworker.0 00000100:00080000:2.0:1788863660.128735:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863660.132513:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863660.138371:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323980160 00000100:00100000:3.0:1788863660.138389:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323980160 00000100:00100000:3.0:1788863660.138478:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323979776 00000100:00100000:3.0:1788863660.138482:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323979776 00000100:00080000:1.0:1788863660.138483:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863660.138563:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323979904 00000100:00100000:3.0:1788863660.138568:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323979904 00000100:00100000:3.0:1788863660.139051:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788863660.139067:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759323980160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863660.139992:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788863660.140007:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323979776:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788863660.140478:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863660.140839:0:5842:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788863660.140863:0:5842:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788863660.140893:0:6707:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788863660.140903:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788863660.140928:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759323979904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863660.140988:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323979776:12345-0@lo:400:kworker.0 Request processed in 984us (20136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863660.140996:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788863660.141741:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323979776:0@lo:400:kworker.0 00000100:00100000:2.0:1788863660.142818:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759323979904:12345-0@lo:400:kworker.0 Request processed in 1890us (10308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863660.142832:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788863660.142932:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759323980160:0@lo:400:kworker.0 00000100:00100000:1.0:1788863660.144600:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759323979904:0@lo:400:kworker.0 00000100:00100000:3.0:1788863660.148811:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759323980160:12345-0@lo:400:kworker.0 Request processed in 9738us (28049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863660.148828:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1788863661.018367:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863661.373259:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863661.373321:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863661.373368:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298781440 00000100:00100000:0.0:1788863661.373383:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298781440 00000100:00100000:0.0:1788863661.373490:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:0.0:1788863661.373505:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298781440:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863661.373679:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298781312 00000100:00100000:3.0:1788863661.373685:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298781312 00000100:00100000:3.0:1788863661.373723:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 200 00000100:00100000:3.0:1788863661.373743:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2351:x1875759298781312:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863661.373825:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298781440:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 318us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863661.373834:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00080000:0.0:1788863661.373889:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863661.376534:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2351:x1875759298781312:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 2767us (3267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863661.376556:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 200 00010000:00010000:0.0:1788863662.039725:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863662.180496:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323980288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863662.180567:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863662.180637:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323980288 00000100:00100000:0.0:1788863662.180645:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323980288 00000100:00100000:0.0:1788863662.180693:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788863662.180700:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323980288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863662.180737:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863662.180778:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323980288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863662.180784:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788863662.180804:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788863662.180830:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd28d2a00 x1875759323980288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863662.180847:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323980288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863663.064887:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863664.086228:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863665.110305:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863665.238286:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323980544:0@lo:400:kworker.0 00000100:00100000:0.0:1788863665.238375:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863665.238448:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759323981056:0@lo:400:kworker.0 00000100:00100000:0.0:1788863665.238473:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863665.238497:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788863665.238502:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323980672:0@lo:400:kworker.0 00000100:00100000:0.0:1788863665.238521:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863665.238538:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323981184:0@lo:400:kworker.0 00000100:00100000:0.0:1788863665.238557:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863665.238590:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323980544 00000100:00100000:0.0:1788863665.238598:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323980544 00000100:00100000:0.0:1788863665.238658:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788863665.238667:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323980544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863665.238690:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323980416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863665.238718:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323980544:12345-0@lo:400:kworker.0 Request processed in 52us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863665.238719:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863665.238725:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788863665.238737:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323980928:0@lo:400:kworker.0 00000100:00100000:0.0:1788863665.238754:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323981056 00000100:00100000:0.0:1788863665.238757:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323981056 00000100:00100000:1.0:1788863665.238769:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863665.238786:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863665.238789:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323980672 00000100:00100000:0.0:1788863665.238791:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323980672 00000100:00100000:1.0:1788863665.238798:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759323980800:0@lo:400:kworker.0 00000100:00100000:0.0:1788863665.238807:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788863665.238812:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759323981056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863665.238819:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863665.238840:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759323981056:12345-0@lo:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863665.238843:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323980416 00000100:00100000:1.0:1788863665.238846:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323980416 00000100:00100000:0.0:1788863665.238846:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788863665.238873:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323980800 00000100:00100000:0.0:1788863665.238876:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323980800 00000100:00100000:0.0:1788863665.238888:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788863665.238895:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788863665.238900:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323980416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863665.238900:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323980672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863665.238929:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323980672:12345-0@lo:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863665.238934:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00002000:00000024:1.0:1788863665.238944:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863665.238944:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788863665.238950:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759323980800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863665.238979:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759323980800:12345-0@lo:400:kworker.0 Request processed in 29us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863665.238986:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788863665.239013:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323981184 00000100:00100000:0.0:1788863665.239017:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323981184 00000100:00100000:0.0:1788863665.239059:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323980928 00000100:00100000:0.0:1788863665.239062:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323980928 00000100:00100000:0.0:1788863665.239086:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788863665.239095:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875759323981184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863665.239127:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875759323980416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 224us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863665.239134:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788863665.239134:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875759323981184:12345-0@lo:400:kworker.0 Request processed in 42us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863665.239141:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788863665.239157:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788863665.239166:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323980928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863665.239187:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759323980800:0@lo:400:kworker.0 00000100:00100000:0.0:1788863665.239196:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323980928:12345-0@lo:400:kworker.0 Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863665.239201:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788863665.239204:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee550000 x1875759323980416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863665.239221:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323980416:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788863665.239223:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863665.239228:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788863665.239231:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee553800 x1875759323980928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788863665.239231:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863665.239240:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323980928:0@lo:400:kworker.0 00000100:00100000:0.0:1788863665.239261:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323980672:0@lo:400:kworker.0 00010000:00080000:0.0:1788863665.239285:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee553100 x1875759323981184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863665.239294:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323981184:0@lo:400:kworker.0 00000100:00100000:0.0:1788863665.239303:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323980544:0@lo:400:kworker.0 00000100:00100000:0.0:1788863665.239313:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759323981056:0@lo:400:kworker.0 00010000:00010000:0.0:1788863666.137185:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863666.496446:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863666.496497:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863666.496692:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298781696 00000100:00100000:0.0:1788863666.496703:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298781696 00000100:00100000:0.0:1788863666.496776:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1788863666.496786:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2352:x1875759298781696:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863666.496884:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2352:x1875759298781696:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 99us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863666.496893:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00080000:2.0:1788863666.496894:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863666.497511:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298781568 00000100:00100000:3.0:1788863666.497518:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298781568 00000100:00100000:3.0:1788863666.497557:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 202 00000100:00100000:3.0:1788863666.497564:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2352:x1875759298781568:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863666.497605:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2352:x1875759298781568:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 41us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863666.497612:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 202 00010000:00010000:1.0:1788863667.159081:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863667.288319:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323981312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863667.288398:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863667.288552:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323981312 00000100:00100000:0.0:1788863667.288559:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323981312 00000100:00100000:0.0:1788863667.288629:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788863667.288638:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5770e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323981312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863667.288688:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788863667.288763:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863667.292324:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5770e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323981312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3676us (3915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863667.292342:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788863667.295648:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbd9880 x1875759323981312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863667.295677:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323981312:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788863668.182105:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863669.214616:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863670.232833:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863670.361191:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323981440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863670.361395:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863670.361513:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323981440 00000100:00100000:1.0:1788863670.361522:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323981440 00000100:00100000:1.0:1788863670.361593:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788863670.361603:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323981440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863670.361651:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863670.361705:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323981440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863670.361712:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788863670.361733:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788863670.361763:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbd8e00 x1875759323981440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863670.361784:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323981440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863670.364703:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323981696:0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.364803:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863670.364876:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788863670.364883:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323981568:0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.364917:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863670.364959:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323982080:0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.364982:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863670.365016:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323981696 00000100:00100000:3.0:1788863670.365038:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323981696 00000100:00100000:3.0:1788863670.365091:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323982080 00000100:00100000:3.0:1788863670.365095:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323982080 00000100:00100000:3.0:1788863670.365133:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788863670.365142:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323981696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.365274:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323981696:12345-0@lo:400:kworker.0 Request processed in 62us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863670.365284:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788863670.365305:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788863670.365312:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323982080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.365341:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323982080:12345-0@lo:400:kworker.0 Request processed in 30us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863670.365348:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788863670.365369:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323981568 00000100:00100000:3.0:1788863670.365373:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323981568 00000100:00100000:3.0:1788863670.365398:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788863670.365404:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759323981568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.365435:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759323981568:12345-0@lo:400:kworker.0 Request processed in 31us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863670.365441:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788863670.365498:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323981568:0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.365513:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323982080:0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.365522:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323981696:0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.365555:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323981824:0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.365579:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863670.365612:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863670.365618:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323981952:0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.365643:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863670.365673:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323981824 00000100:00100000:3.0:1788863670.365677:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323981824 00000100:00100000:3.0:1788863670.365704:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788863670.365711:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323981824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.365745:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323981824:12345-0@lo:400:kworker.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863670.365751:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788863670.365770:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323981952 00000100:00100000:3.0:1788863670.365774:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323981952 00000100:00100000:3.0:1788863670.365805:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788863670.365812:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323981952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.365843:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323981952:12345-0@lo:400:kworker.0 Request processed in 32us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863670.365849:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788863670.365913:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd28d2d80 x1875759323981952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863670.365925:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323981952:0@lo:400:kworker.0 00000100:00100000:3.0:1788863670.365935:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323981824:0@lo:400:kworker.0 00000100:00080000:3.0:1788863670.365968:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863670.365973:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788863671.256061:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863671.619896:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863671.619956:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863671.620106:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298781952 00000100:00100000:3.0:1788863671.620117:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298781952 00000100:00100000:3.0:1788863671.620191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:3.0:1788863671.620203:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298781952:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863671.620296:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298781952:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 95us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863671.620305:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00080000:1.0:1788863671.620370:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863671.628803:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298781824 00000100:00100000:2.0:1788863671.628821:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298781824 00000100:00100000:2.0:1788863671.630595:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 204 00000100:00100000:2.0:1788863671.630616:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2351:x1875759298781824:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863671.630703:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2351:x1875759298781824:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 96us (10857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863671.630711:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 204 00010000:00010000:3.0:1788863672.278194:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863672.407615:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863672.407648:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323982208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863672.407741:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863672.407816:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323982208 00000100:00100000:1.0:1788863672.407827:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323982208 00000100:00100000:1.0:1788863672.407953:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863672.409378:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323982208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863672.410384:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863672.410535:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323982208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2567us (2789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863672.410550:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788863672.410616:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788863672.410678:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbda680 x1875759323982208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863672.410713:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323982208:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863673.302150:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863674.328534:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863675.353803:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863675.478252:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfbbda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323982336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863675.478390:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863675.478894:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323982336 00000100:00100000:1.0:1788863675.478915:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323982336 00000100:00100000:2.0:1788863675.478978:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323982592:0@lo:400:kworker.0 00000100:00100000:2.0:1788863675.479035:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863675.479073:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863675.479087:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323982720:0@lo:400:kworker.0 00000100:00100000:1.0:1788863675.479100:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863675.479116:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323982336:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863675.479130:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788863675.479185:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788863675.479194:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863675.479298:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323982336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 186us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863675.479306:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788863675.479446:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323982592 00000100:00100000:3.0:1788863675.479452:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323982592 00000100:00100000:3.0:1788863675.479501:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323982720 00000100:00100000:3.0:1788863675.479505:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323982720 00000100:00100000:3.0:1788863675.479541:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788863675.479548:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323982592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863675.479591:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323982592:12345-0@lo:400:kworker.0 Request processed in 44us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863675.479599:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788863675.479612:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788863675.479618:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323982720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863675.479648:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323982720:12345-0@lo:400:kworker.0 Request processed in 30us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863675.479659:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788863675.479703:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323982464:0@lo:400:kworker.0 00000100:00100000:0.0:1788863675.479755:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863675.479793:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759323982976:0@lo:400:kworker.0 00000100:00080000:1.0:1788863675.479906:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863675.480062:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323982720:0@lo:400:kworker.0 00000100:00100000:2.0:1788863675.480075:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323982592:0@lo:400:kworker.0 00000100:00100000:2.0:1788863675.480127:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323982848:0@lo:400:kworker.0 00000100:00100000:1.0:1788863675.480189:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323982464 00000100:00100000:1.0:1788863675.480194:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323982464 00000100:00100000:1.0:1788863675.480227:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788863675.480235:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759323982464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863675.486547:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788863675.488951:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfbbda680 x1875759323982336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863675.488989:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfbbda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323982336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863675.489403:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759323982464:12345-0@lo:400:kworker.0 Request processed in 9166us (9644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863675.489415:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788863675.490738:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323982848 00000100:00100000:3.0:1788863675.490753:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323982848 00000100:00100000:3.0:1788863675.490866:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788863675.490877:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323982848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863675.491113:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323982848:12345-0@lo:400:kworker.0 Request processed in 237us (4575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863675.491138:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788863675.491227:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd5771c00 x1875759323982848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863675.491243:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323982848:0@lo:400:kworker.0 00000100:00080000:1.0:1788863675.491316:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863675.496523:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863675.496900:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323982464:0@lo:400:kworker.0 00000100:00100000:3.0:1788863675.497179:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323982976 00000100:00100000:3.0:1788863675.497195:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323982976 00000100:00100000:3.0:1788863675.497310:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788863675.497321:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759323982976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863675.498112:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759323982976:12345-0@lo:400:kworker.0 Request processed in 789us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863675.498122:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788863675.498217:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863675.506571:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759323982976:0@lo:400:kworker.0 00010000:00010000:2.0:1788863676.374345:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863676.523074:0:10115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 06:34:34 (1788863674) === 00000100:00100000:1.0:1788863676.739117:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863676.739263:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298782080 00000100:00100000:2.0:1788863676.739274:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298782080 00000100:00100000:2.0:1788863676.739338:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:2.0:1788863676.739350:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2352:x1875759298782080:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863676.739434:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2352:x1875759298782080:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 88us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863676.739442:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:1.0:1788863676.739753:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863676.739834:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298782208 00000100:00100000:2.0:1788863676.739839:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298782208 00000100:00100000:2.0:1788863676.739984:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:2.0:1788863676.739992:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2352:x1875759298782208:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863676.740032:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2352:x1875759298782208:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 41us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863676.740038:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00080000:1.0:1788863676.740193:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863676.994885:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863676.995609:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298782336 00000100:00100000:1.0:1788863676.995628:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298782336 00000100:00100000:1.0:1788863676.995711:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:1.0:1788863676.995723:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:8124:x1875759298782336:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788863676.995746:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863676.995771:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7a600/0x744cd7666bbbabc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330dac expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.995889:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7a600/0x744cd7666bbbabc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330dac expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.995907:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7a600/0x744cd7666bbbabc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330dac expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863676.995918:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a600, rc 0) 00000100:00100000:1.0:1788863676.996008:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:8124:x1875759298782336:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 287us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863676.996027:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:2.0:1788863677.010733:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863677.010949:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298782464 00000100:00100000:0.0:1788863677.010967:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298782464 00000100:00100000:0.0:1788863677.011102:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 208 00000100:00100000:0.0:1788863677.011116:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:8124:x1875759298782464:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788863677.011518:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:8124:x1875759298782464:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 405us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863677.011528:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 208 00000100:00100000:3.0:1788863677.014535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863677.022148:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298782592 00000100:00100000:1.0:1788863677.022187:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298782592 00000100:00100000:1.0:1788863677.022420:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:1.0:1788863677.022434:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:8124:x1875759298782592:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788863677.022793:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:8124:x1875759298782592:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 361us (8271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863677.022802:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:3.0:1788863677.033422:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863677.033616:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298782720 00000100:00100000:0.0:1788863677.033636:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298782720 00000100:00100000:0.0:1788863677.033713:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:0.0:1788863677.033724:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:8128:x1875759298782720:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863677.034609:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:8128:x1875759298782720:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 877us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863677.034622:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:2.0:1788863677.059061:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863677.059299:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298782848 00000100:00100000:3.0:1788863677.059310:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298782848 00000100:00100000:3.0:1788863677.059367:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:3.0:1788863677.059376:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:8128:x1875759298782848:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788863677.059681:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:8128:x1875759298782848:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 305us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863677.059690:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:3.0:1788863677.066151:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863677.066616:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298782976 00000100:00100000:0.0:1788863677.066634:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298782976 00000100:00100000:0.0:1788863677.066724:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:0.0:1788863677.066738:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:8124:x1875759298782976:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788863677.066765:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863677.066793:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0030600/0x744cd7666bbbabc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330dd6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863677.066841:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0030600/0x744cd7666bbbabc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330dd6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863677.066909:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0030600/0x744cd7666bbbabc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330dd6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863677.066930:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030600, rc 0) 00000100:00100000:0.0:1788863677.067019:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:8124:x1875759298782976:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 284us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863677.067026:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:0.0:1788863677.078590:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863677.078884:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298783104 00000100:00100000:1.0:1788863677.078895:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298783104 00000100:00100000:1.0:1788863677.078968:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:1.0:1788863677.078994:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:8124:x1875759298783104:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788863677.079022:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788863677.079039:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788863677.079042:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788863677.079046:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788863677.079048:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788863677.092007:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:8124:x1875759298783104:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 13002us (13418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863677.092024:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:3.0:1788863677.100987:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863677.105085:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298783232 00000100:00100000:2.0:1788863677.105107:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298783232 00000100:00100000:2.0:1788863677.105420:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 214 00000100:00100000:2.0:1788863677.105432:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:8124:x1875759298783232:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788863677.105451:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863677.105473:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbabd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ddd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863677.105504:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbabd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ddd expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863677.105517:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbabd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ddd expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863677.105526:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554000, rc 0) 00000100:00100000:2.0:1788863677.105613:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:8124:x1875759298783232:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 184us (4640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863677.105620:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 214 00000100:00100000:3.0:1788863677.109721:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863677.114708:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298783360 00000100:00100000:0.0:1788863677.114728:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298783360 00000100:00100000:0.0:1788863677.114795:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 215 00000100:00100000:0.0:1788863677.114806:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:8124:x1875759298783360:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788863677.115180:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:8124:x1875759298783360:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 375us (5478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863677.115189:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 215 00000100:00100000:1.0:1788863677.117066:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863677.117170:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298783488 00000100:00100000:0.0:1788863677.117181:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298783488 00000100:00100000:0.0:1788863677.117280:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:0.0:1788863677.117294:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:8124:x1875759298783488:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788863677.117588:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:8124:x1875759298783488:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 296us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863677.117598:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:3.0:1788863677.122715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863677.129559:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298783616 00000100:00100000:2.0:1788863677.129576:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298783616 00000100:00100000:0.0:1788863677.131761:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 217 00000100:00100000:0.0:1788863677.131778:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:8132:x1875759298783616:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863677.132732:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:8132:x1875759298783616:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 950us (10022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863677.132743:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 217 00000100:00100000:1.0:1788863677.138597:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863677.138701:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298783744 00000100:00100000:0.0:1788863677.138711:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298783744 00000100:00100000:0.0:1788863677.138771:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:0.0:1788863677.138783:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:8132:x1875759298783744:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788863677.145522:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:8132:x1875759298783744:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 6726us (6919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863677.145540:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:2.0:1788863677.151530:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863677.151577:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863677.154619:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298783872 00000100:00100000:0.0:1788863677.154638:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298783872 00000100:00100000:1.0:1788863677.155291:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298784256 00000100:00100000:1.0:1788863677.155300:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298784256 00000100:00100000:1.0:1788863677.155377:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1788863677.155393:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298784256:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863677.155528:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298784256:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 139us (3948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863677.155536:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1788863677.155557:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1788863677.155562:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2349:x1875759298783872:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788863677.155589:0:9496:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 93b25027-f4fd-4c57-8714-3a69d8e44d8a@192.168.204.51@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:1.0:1788863677.155631:0:9496:0:(genops.c:1384:class_connect()) connect: client 93b25027-f4fd-4c57-8714-3a69d8e44d8a, cookie 0x744cd7666bbbabd7 00000004:00100000:1.0:1788863677.155673:0:9496:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788863677.156084:0:9496:0:(import.c:65:import_set_state_nolock()) ffff8e8bfb721800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863677.156122:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:2349:x1875759298783872:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 558us (4604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863677.156148:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1788863677.162357:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863677.162594:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298784000 00000100:00100000:2.0:1788863677.162620:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298784000 00000100:00100000:2.0:1788863677.162762:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1788863677.162778:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:0:x1875759298784000:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788863677.162910:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788863677.163073:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:0:x1875759298784000:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 299us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863677.163081:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00080000:1.0:1788863677.163349:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863677.164537:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863677.166283:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298784128 00000100:00100000:2.0:1788863677.166299:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298784128 00000100:00100000:2.0:1788863677.166375:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:2.0:1788863677.166385:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:8124:x1875759298784128:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788863677.166431:0:6707:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788863677.166519:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:8124:x1875759298784128:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 134us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863677.166529:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1788863677.169355:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863677.169480:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298784384 00000100:00100000:3.0:1788863677.169495:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298784384 00000100:00100000:3.0:1788863677.169580:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1788863677.169594:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:8124:x1875759298784384:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788863677.169942:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:8124:x1875759298784384:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 350us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863677.169952:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1788863677.174019:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863677.174186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863677.174396:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863677.174515:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298784512 00000100:00100000:2.0:1788863677.174530:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298784512 00000100:00100000:2.0:1788863677.174590:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298784640 00000100:00100000:2.0:1788863677.174593:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298784640 00000100:00100000:2.0:1788863677.174610:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1788863677.174621:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1875759298784512:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788863677.174666:0:6680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 93b25027-f4fd-4c57-8714-3a69d8e44d8a@192.168.204.51@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:2.0:1788863677.174718:0:6680:0:(genops.c:1384:class_connect()) connect: client 93b25027-f4fd-4c57-8714-3a69d8e44d8a, cookie 0x744cd7666bbbabde 00002000:00100000:2.0:1788863677.174737:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 93b25027-f4fd-4c57-8714-3a69d8e44d8a/ffff8e8bff21f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788863677.174775:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788863677.175563:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788863677.175624:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8e8becca4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788863677.175782:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:2349:x1875759298784512:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 1159us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863677.175792:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1788863677.175889:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1788863677.175896:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1875759298784640:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788863677.175929:0:6680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 93b25027-f4fd-4c57-8714-3a69d8e44d8a@192.168.204.51@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:2.0:1788863677.175962:0:6680:0:(genops.c:1384:class_connect()) connect: client 93b25027-f4fd-4c57-8714-3a69d8e44d8a, cookie 0x744cd7666bbbabe5 00002000:00100000:2.0:1788863677.175975:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 93b25027-f4fd-4c57-8714-3a69d8e44d8a/ffff8e8becca6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788863677.175999:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788863677.176560:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788863677.176595:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8e8becca0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788863677.176648:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:2349:x1875759298784640:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 749us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863677.176656:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:0.0:1788863677.176956:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298784768 00000100:00100000:0.0:1788863677.176967:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298784768 00000100:00100000:0.0:1788863677.177018:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:0.0:1788863677.177026:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:8124:x1875759298784768:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788863677.177334:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788863677.177406:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:8124:x1875759298784768:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 381us (3405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863677.177414:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00010000:00010000:1.0:1788863677.398768:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863677.527070:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863677.527108:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323983104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863677.527218:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863677.527466:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323983104 00000100:00100000:2.0:1788863677.527480:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323983104 00000100:00100000:2.0:1788863677.527573:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788863677.527587:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323983104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863677.527621:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863677.527679:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323983104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863677.527687:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788863677.531700:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788863677.531828:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff177100 x1875759323983104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863677.531918:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323983104:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788863678.424447:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863679.447957:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788863680.155080:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 93b25027-f4fd-4c57-8714-3a69d8e44d8a 00010000:00010000:2.0:1788863680.470467:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863680.598638:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323983232:0@lo:400:kworker.0 00000100:00100000:2.0:1788863680.598753:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863680.598810:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323983744:0@lo:400:kworker.0 00000100:00100000:2.0:1788863680.598879:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863680.598914:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863680.598920:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323983616:0@lo:400:kworker.0 00000100:00100000:2.0:1788863680.598949:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863680.598981:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323983360:0@lo:400:kworker.0 00000100:00100000:2.0:1788863680.599005:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863680.599021:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323983872:0@lo:400:kworker.0 00000100:00100000:2.0:1788863680.599040:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863680.599059:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863680.599064:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323983488:0@lo:400:kworker.0 00000100:00100000:2.0:1788863680.599083:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863680.599114:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323983232 00000100:00100000:2.0:1788863680.599122:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323983232 00000100:00100000:3.0:1788863680.600727:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323983744 00000100:00100000:3.0:1788863680.600737:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323983744 00000100:00100000:3.0:1788863680.600798:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323983360 00000100:00100000:3.0:1788863680.600801:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323983360 00000100:00100000:3.0:1788863680.600815:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323983488 00000100:00100000:3.0:1788863680.600817:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323983488 00000100:00100000:3.0:1788863680.600835:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788863680.600846:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323983744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863680.600978:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323983744:12345-0@lo:400:kworker.0 Request processed in 134us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863680.600985:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788863680.601003:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788863680.601008:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323983360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863680.601032:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323983360:12345-0@lo:400:kworker.0 Request processed in 24us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863680.601038:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788863680.601046:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788863680.601051:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323983488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863680.601072:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323983488:12345-0@lo:400:kworker.0 Request processed in 21us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863680.601100:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788863680.601122:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863680.601147:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323984000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863680.601314:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863680.601367:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323984000 00000100:00100000:3.0:1788863680.601371:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323984000 00000100:00100000:3.0:1788863680.601405:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788863680.601411:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323984000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863680.601457:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863680.601495:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323984000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863680.602703:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788863680.602727:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759323983232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863680.602799:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759323983232:12345-0@lo:400:kworker.0 Request processed in 85us (4048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863680.602806:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788863680.602934:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323983616 00000100:00100000:1.0:1788863680.602943:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323983616 00000100:00100000:1.0:1788863680.602982:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323983872 00000100:00100000:1.0:1788863680.602985:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323983872 00000100:00100000:1.0:1788863680.602996:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863680.603001:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323983616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863680.603036:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323983616:12345-0@lo:400:kworker.0 Request processed in 35us (4087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863680.603042:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863680.603052:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788863680.603056:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875759323983872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863680.603093:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875759323983872:12345-0@lo:400:kworker.0 Request processed in 22us (4038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863680.603099:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788863680.603263:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788863680.603296:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863680.603300:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788863680.603342:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd28d1880 x1875759323984000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863680.603367:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323984000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863680.603411:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323983488:0@lo:400:kworker.0 00000100:00100000:3.0:1788863680.603423:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323983360:0@lo:400:kworker.0 00010000:00080000:3.0:1788863680.603432:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfb531f80 x1875759323983872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863680.603440:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323983872:0@lo:400:kworker.0 00010000:00080000:3.0:1788863680.604753:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfb530700 x1875759323983616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863680.604790:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323983616:0@lo:400:kworker.0 00000100:00100000:3.0:1788863680.604818:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323983232:0@lo:400:kworker.0 00000100:00100000:3.0:1788863680.604835:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323983744:0@lo:400:kworker.0 00000001:00100000:0.0:1788863680.716984:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 93b25027-f4fd-4c57-8714-3a69d8e44d8a 00000001:00100000:0.0:1788863681.200210:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 93b25027-f4fd-4c57-8714-3a69d8e44d8a 00010000:00010000:1.0:1788863681.494214:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863682.371336:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863682.371398:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863682.371445:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863682.371479:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863682.371509:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863682.371555:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298785408 00000100:00100000:1.0:1788863682.371584:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298785408 00000100:00100000:0.0:1788863682.371622:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298785152 00000100:00100000:0.0:1788863682.371631:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298785152 00000100:00100000:1.0:1788863682.371657:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298785280 00000100:00100000:1.0:1788863682.371662:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298785280 00000100:00100000:0.0:1788863682.371677:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298785024 00000100:00100000:0.0:1788863682.371683:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298785024 00000100:00100000:1.0:1788863682.371694:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:0.0:1788863682.371725:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:0.0:1788863682.371736:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298785152:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863682.371764:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298784896 00000100:00100000:3.0:1788863682.371769:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298784896 00000100:00100000:3.0:1788863682.371807:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00100000:3.0:1788863682.371816:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298784896:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863682.371843:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298785152:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 92us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863682.371893:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298784896:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 35us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863682.371902:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:3.0:1788863682.371906:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00100000:0.0:1788863682.371929:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:0.0:1788863682.371951:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298785024:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:3.0:1788863682.371956:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863682.371963:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863682.371966:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863682.371984:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298785024:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 34us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863682.371991:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:3.0:1788863682.372014:0:6677:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788863682.372023:0:6677:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788863682.372218:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298785408:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863682.372265:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298785408:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 562us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863682.373239:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:2.0:1788863682.373260:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298785280:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863682.373312:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298785280:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 61us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863682.373320:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:1.0:1788863682.383942:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00010000:00010000:2.0:1788863682.518417:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863682.646374:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323984128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863682.646497:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863682.646712:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323984128 00000100:00100000:0.0:1788863682.646726:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323984128 00000100:00100000:0.0:1788863682.646836:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788863682.646883:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323984128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863682.646954:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788863682.647116:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863682.651561:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323984128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4692us (5043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863682.651594:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788863682.651687:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff177480 x1875759323984128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863682.651889:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323984128:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788863683.519841:0:10314:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788863683.555276:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863684.566058:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863685.590182:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863685.718193:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323984256:0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.718540:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863685.718604:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323984768:0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.718635:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863685.718675:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863685.718681:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323984640:0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.718707:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863685.718738:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323984384:0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.718763:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863685.718779:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323984896:0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.718797:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863685.718815:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863685.718820:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323984512:0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.718841:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863685.718903:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323984256 00000100:00100000:2.0:1788863685.718914:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323984256 00000100:00100000:2.0:1788863685.718973:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788863685.718984:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759323984256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.719059:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759323984256:12345-0@lo:400:kworker.0 Request processed in 76us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863685.719066:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788863685.719102:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323984768 00000100:00100000:2.0:1788863685.719105:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323984768 00000100:00100000:1.0:1788863685.721018:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323984384 00000100:00100000:1.0:1788863685.721034:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323984384 00000100:00100000:1.0:1788863685.721095:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323984512 00000100:00100000:1.0:1788863685.721098:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323984512 00000100:00100000:1.0:1788863685.721128:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788863685.721140:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323984768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.721564:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788863685.721578:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323984384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.721666:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323984384:12345-0@lo:400:kworker.0 Request processed in 93us (2900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863685.721673:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788863685.721693:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788863685.721699:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323984512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.721729:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323984512:12345-0@lo:400:kworker.0 Request processed in 31us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863685.721734:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788863685.721819:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323984256:0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.721888:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323984640 00000100:00100000:2.0:1788863685.721893:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323984640 00000100:00100000:2.0:1788863685.721936:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323984896 00000100:00100000:2.0:1788863685.721940:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323984896 00000100:00100000:2.0:1788863685.721966:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788863685.721972:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323984640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.722035:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323984640:12345-0@lo:400:kworker.0 Request processed in 63us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863685.722041:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788863685.722055:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788863685.722062:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323984896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.722093:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323984896:12345-0@lo:400:kworker.0 Request processed in 33us (3295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863685.722099:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788863685.722133:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfb531180 x1875759323984640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863685.722175:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323984640:0@lo:400:kworker.0 00000100:00080000:2.0:1788863685.723754:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863685.723768:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863685.723773:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863685.723805:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323985024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863685.723903:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863685.724005:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323984512:0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.724024:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323984384:0@lo:400:kworker.0 00010000:00080000:2.0:1788863685.724036:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bfb533800 x1875759323984896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863685.724047:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323984896:0@lo:400:kworker.0 00000100:00100000:3.0:1788863685.724163:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323985024 00000100:00100000:3.0:1788863685.724171:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323985024 00000100:00100000:1.0:1788863685.731112:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323984768:12345-0@lo:400:kworker.0 Request processed in 9965us (12466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863685.731130:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788863685.740804:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323984768:0@lo:400:kworker.0 00000100:00100000:2.0:1788863685.744720:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788863685.744758:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323985024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863685.744817:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863685.744994:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323985024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (21089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863685.745004:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788863685.745198:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd28d1880 x1875759323985024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863685.745228:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323985024:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788863686.617943:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863687.503901:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863687.503948:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863687.503975:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863687.503994:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863687.504074:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863687.504125:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298785792 00000100:00100000:2.0:1788863687.504138:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298785792 00000100:00100000:2.0:1788863687.504208:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298785664 00000100:00100000:2.0:1788863687.504214:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298785664 00000100:00100000:2.0:1788863687.504260:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:2.0:1788863687.504272:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298785792:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863687.504363:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298785792:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 93us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863687.504372:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:2.0:1788863687.504404:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:2.0:1788863687.504411:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298785664:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863687.504437:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298785664:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863687.504445:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:2.0:1788863687.504467:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298786048 00000100:00100000:2.0:1788863687.504471:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298786048 00000100:00100000:2.0:1788863687.504498:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298785920 00000100:00100000:2.0:1788863687.504501:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298785920 00000100:00100000:2.0:1788863687.504518:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:2.0:1788863687.504524:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298786048:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863687.504578:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298786048:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 53us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863687.504584:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:2.0:1788863687.504597:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:2.0:1788863687.504620:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298785920:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863687.504646:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298785920:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 44us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863687.504659:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00080000:2.0:1788863687.504687:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863687.504692:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863687.504696:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863687.505709:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298785536 00000100:00100000:3.0:1788863687.505721:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298785536 00000100:00100000:3.0:1788863687.505781:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 222 00000100:00100000:3.0:1788863687.505792:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298785536:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863687.505895:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298785536:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 103us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863687.505903:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 222 00010000:00010000:1.0:1788863687.644273:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863687.767211:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863687.767240:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323985152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863687.767333:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863687.767659:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323985152 00000100:00100000:0.0:1788863687.767670:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323985152 00000100:00100000:0.0:1788863687.767746:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788863687.767757:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323985152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863687.767800:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863687.767887:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323985152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863687.767895:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788863687.767971:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788863687.768009:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee551f80 x1875759323985152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863687.768031:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323985152:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788863688.664526:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863689.687716:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863690.710144:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863690.839827:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323985280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863690.840056:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863690.840165:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323985280 00000100:00100000:3.0:1788863690.840176:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323985280 00000100:00100000:3.0:1788863690.840254:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788863690.840266:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323985280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863690.840322:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863690.840386:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323985280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863690.840394:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788863690.840422:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788863690.840487:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd28d3100 x1875759323985280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863690.844272:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323985280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863690.844443:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323985408:0@lo:400:kworker.0 00000100:00100000:2.0:1788863690.844558:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863690.844609:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323985920:0@lo:400:kworker.0 00000100:00100000:2.0:1788863690.844642:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863690.844672:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863690.844678:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323985536:0@lo:400:kworker.0 00000100:00100000:3.0:1788863690.844701:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323985792:0@lo:400:kworker.0 00000100:00100000:2.0:1788863690.844702:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863690.844742:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323985408 00000100:00100000:2.0:1788863690.844754:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323985408 00000100:00100000:2.0:1788863690.844825:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788863690.844836:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323985408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863690.845066:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863690.845094:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863690.845101:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759323985664:0@lo:400:kworker.0 00000100:00100000:3.0:1788863690.845126:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863690.845184:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323985792 00000100:00100000:3.0:1788863690.845189:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323985792 00000100:00100000:3.0:1788863690.845238:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788863690.845247:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323985792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863690.845311:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323985792:12345-0@lo:400:kworker.0 Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863690.845319:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788863690.845349:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323985920 00000100:00100000:3.0:1788863690.845353:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323985920 00000100:00100000:2.0:1788863690.846609:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323985408:12345-0@lo:400:kworker.0 Request processed in 1760us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863690.846625:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788863690.846692:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323985536 00000100:00100000:2.0:1788863690.846703:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323985536 00000100:00100000:2.0:1788863690.846743:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323985664 00000100:00100000:2.0:1788863690.846748:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323985664 00000100:00100000:2.0:1788863690.846770:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788863690.846780:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323985920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863690.846824:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323985920:12345-0@lo:400:kworker.0 Request processed in 46us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863690.846846:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788863690.846882:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788863690.846888:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323985536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863690.846924:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788863690.846926:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323985536:12345-0@lo:400:kworker.0 Request processed in 36us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863690.846935:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788863690.846952:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759323985664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863690.847074:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323985536:0@lo:400:kworker.0 00000100:00100000:3.0:1788863690.847196:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759323985664:12345-0@lo:400:kworker.0 Request processed in 260us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863690.847204:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788863690.847249:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863690.847255:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863690.847284:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759323985664:0@lo:400:kworker.0 00010000:00080000:3.0:1788863690.847304:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee224a80 x1875759323985792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863690.847316:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323985792:0@lo:400:kworker.0 00000100:00100000:2.0:1788863690.847670:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323985408:0@lo:400:kworker.0 00000100:00100000:2.0:1788863690.847688:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323985920:0@lo:400:kworker.0 00010000:00010000:2.0:1788863691.739048:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863692.609791:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863692.609882:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863692.609922:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298786304 00000100:00100000:0.0:1788863692.609937:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298786304 00000100:00100000:0.0:1788863692.610040:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:0.0:1788863692.610055:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298786304:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863692.610172:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298786304:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 121us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863692.610181:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00080000:0.0:1788863692.610210:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863692.610793:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298786176 00000100:00100000:3.0:1788863692.610820:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298786176 00000100:00100000:3.0:1788863692.610900:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:3.0:1788863692.610910:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2353:x1875759298786176:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863692.610959:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2353:x1875759298786176:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 51us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863692.610966:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:2.0:1788863692.621153:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863692.621208:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863692.621242:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863692.621284:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298786560 00000100:00100000:2.0:1788863692.621301:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298786560 00000100:00100000:2.0:1788863692.621385:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298786688 00000100:00100000:2.0:1788863692.621389:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298786688 00000100:00100000:2.0:1788863692.621420:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:2.0:1788863692.621432:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf441c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2352:x1875759298786560:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863692.621556:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf441c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2352:x1875759298786560:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 126us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863692.621568:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:2.0:1788863692.621844:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:2.0:1788863692.621891:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2352:x1875759298786688:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863692.621933:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2352:x1875759298786688:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 82us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863692.621941:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:2.0:1788863692.621967:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298786432 00000100:00100000:2.0:1788863692.621972:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298786432 00000100:00100000:2.0:1788863692.622012:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:2.0:1788863692.622020:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2352:x1875759298786432:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863692.622055:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2352:x1875759298786432:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 37us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863692.622062:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00080000:2.0:1788863692.622086:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863692.622091:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863692.622094:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788863692.762986:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863692.896896:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863692.896935:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323986048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863692.897056:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863692.897118:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323986048 00000100:00100000:0.0:1788863692.897131:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323986048 00000100:00080000:2.0:1788863692.897184:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863692.897232:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788863692.897246:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323986048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863692.897307:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863692.897372:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323986048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (318us total) trans 0 rc 0/0 00010000:00080000:2.0:1788863692.897525:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee553b80 x1875759323986048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863692.897559:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323986048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863692.897621:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788863693.784628:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863694.808180:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863695.830252:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863695.958565:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323986176:0@lo:400:kworker.0 00000100:00100000:3.0:1788863695.958695:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863695.958814:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323986304:0@lo:400:kworker.0 00000100:00100000:3.0:1788863695.958874:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863695.958961:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863695.958971:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759323986432:0@lo:400:kworker.0 00000100:00100000:3.0:1788863695.959000:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863695.959039:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323986304 00000100:00100000:3.0:1788863695.959051:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323986304 00000100:00100000:3.0:1788863695.960290:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323986432 00000100:00100000:3.0:1788863695.960307:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323986432 00000100:00100000:2.0:1788863695.960822:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323986176 00000100:00100000:2.0:1788863695.960829:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323986176 00000100:00100000:2.0:1788863695.960895:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788863695.960908:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323986176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863695.961043:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323986176:12345-0@lo:400:kworker.0 Request processed in 137us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863695.961190:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788863695.961246:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788863695.961256:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323986304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863695.961303:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323986304:12345-0@lo:400:kworker.0 Request processed in 49us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863695.961309:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788863695.961560:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788863695.961571:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759323986432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863695.961614:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759323986432:12345-0@lo:400:kworker.0 Request processed in 47us (2614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863695.961620:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788863695.962024:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863695.962045:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323986560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863695.962275:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759323986432:0@lo:400:kworker.0 00000100:00080000:3.0:1788863695.962514:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863695.962545:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323986816:0@lo:400:kworker.0 00000100:00100000:1.0:1788863695.962593:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863695.962605:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323986944:0@lo:400:kworker.0 00000100:00100000:3.0:1788863695.962695:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863695.962736:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323986304:0@lo:400:kworker.0 00000100:00100000:3.0:1788863695.962752:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863695.962757:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323986688:0@lo:400:kworker.0 00000100:00100000:3.0:1788863695.962784:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863695.962815:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323986816 00000100:00100000:3.0:1788863695.962822:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323986816 00000100:00100000:3.0:1788863695.962891:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788863695.962900:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323986816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863695.962945:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323986816:12345-0@lo:400:kworker.0 Request processed in 46us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863695.962964:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788863695.962983:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863695.963004:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323986176:0@lo:400:kworker.0 00000100:00100000:3.0:1788863695.963030:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323986816:0@lo:400:kworker.0 00000100:00100000:3.0:1788863695.963674:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323986688 00000100:00100000:3.0:1788863695.963681:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323986688 00000100:00100000:3.0:1788863695.963724:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788863695.963733:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323986688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863695.963788:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323986688:12345-0@lo:400:kworker.0 Request processed in 56us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863695.963795:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788863695.963814:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788863695.963893:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd28d1180 x1875759323986688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863695.963909:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323986688:0@lo:400:kworker.0 00000100:00100000:1.0:1788863695.964816:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863695.971345:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323986944 00000100:00100000:3.0:1788863695.971384:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323986944 00000100:00100000:3.0:1788863695.971519:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788863695.971533:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323986944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863695.973044:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323986944:12345-0@lo:400:kworker.0 Request processed in 1491us (8210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863695.973066:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788863695.974488:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863695.974614:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323986560 00000100:00100000:2.0:1788863695.974629:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323986560 00000100:00100000:2.0:1788863695.974715:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788863695.974727:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875759323986560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863695.974795:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788863695.976513:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788863695.976639:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff177b80 x1875759323986560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863695.976673:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323986560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863695.981618:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875759323986560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863695.981682:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788863695.982593:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd5771880 x1875759323986944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863695.982778:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323986944:0@lo:400:kworker.0 00010000:00010000:3.0:1788863696.882702:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863697.726803:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863697.726893:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863697.726940:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863697.726972:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863697.726999:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863697.727037:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298786944 00000100:00100000:3.0:1788863697.727052:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298786944 00000100:00100000:3.0:1788863697.727135:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298787072 00000100:00100000:3.0:1788863697.727139:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298787072 00000100:00100000:3.0:1788863697.727172:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:3.0:1788863697.727187:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298786944:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863697.727307:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298786944:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 124us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863697.727333:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:3.0:1788863697.727356:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:3.0:1788863697.727363:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298787072:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863697.727394:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298787072:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 32us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863697.727411:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:3.0:1788863697.727441:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298787200 00000100:00100000:3.0:1788863697.727445:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298787200 00000100:00100000:3.0:1788863697.727478:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298787328 00000100:00100000:3.0:1788863697.727481:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298787328 00000100:00100000:3.0:1788863697.727505:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1788863697.727512:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2349:x1875759298787200:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:3.0:1788863697.727538:0:10277:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbabde 00000100:00080000:3.0:1788863697.727549:0:10277:0:(import.c:65:import_set_state_nolock()) ffff8e8becca4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788863697.727608:0:10277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788863697.728132:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+2:2349:x1875759298787200:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 617us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863697.728140:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1788863697.728158:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1788863697.728168:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2349:x1875759298787328:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:3.0:1788863697.728186:0:10277:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbabe5 00000100:00080000:3.0:1788863697.728195:0:10277:0:(import.c:65:import_set_state_nolock()) ffff8e8becca0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788863697.728234:0:10277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788863697.728478:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+2:2349:x1875759298787328:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 311us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863697.728503:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00080000:3.0:1788863697.728536:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863697.728542:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863697.728545:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788863697.728749:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863697.728759:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863697.730054:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298786816 00000100:00100000:2.0:1788863697.730071:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298786816 00000100:00100000:2.0:1788863697.730197:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:2.0:1788863697.731138:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298786816:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863697.731279:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298786816:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 162us (4500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863697.731289:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 226 00010000:00010000:2.0:1788863697.882303:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863698.006661:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323987072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863698.006765:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863698.006930:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323987072 00000100:00100000:3.0:1788863698.006941:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323987072 00000100:00100000:3.0:1788863698.007034:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788863698.007047:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323987072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863698.007121:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863698.007191:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323987072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863698.007200:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788863698.007372:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788863698.007424:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff176300 x1875759323987072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863698.007450:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323987072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788863698.902219:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863699.926278:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788863700.649386:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 93b25027-f4fd-4c57-8714-3a69d8e44d8a 00000020:00000080:3.0:1788863700.649399:0:6708:0:(genops.c:885:class_export_put()) final put ffff8e8bff21f000/93b25027-f4fd-4c57-8714-3a69d8e44d8a 00000020:00000080:1.0:1788863700.649482:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bff21f000/93b25027-f4fd-4c57-8714-3a69d8e44d8a for lustre-OST0000 00000020:00000080:1.0:1788863700.649559:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8becca4800 for lustre-OST0000 00010000:00010000:3.0:1788863700.952263:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863701.078371:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323987328:0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.078473:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863701.078546:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323987840:0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.078572:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863701.078605:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788863701.078611:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323987200:0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.078639:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863701.078659:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323987712:0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.078697:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863701.078724:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323987456:0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.078744:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863701.078760:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863701.078764:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323987584:0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.078783:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863701.078817:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323987328 00000100:00100000:3.0:1788863701.078825:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323987328 00000100:00100000:3.0:1788863701.078894:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323987712 00000100:00100000:3.0:1788863701.078897:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323987712 00000100:00100000:3.0:1788863701.078922:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323987456 00000100:00100000:3.0:1788863701.078925:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323987456 00000100:00100000:3.0:1788863701.078943:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788863701.078951:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323987328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.079013:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323987328:12345-0@lo:400:kworker.0 Request processed in 63us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863701.079021:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788863701.079039:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788863701.079045:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323987712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.079189:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323987712:12345-0@lo:400:kworker.0 Request processed in 23us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863701.079197:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788863701.079211:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788863701.079217:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323987456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.079400:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323987456:12345-0@lo:400:kworker.0 Request processed in 182us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863701.079407:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788863701.079439:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323987840 00000100:00100000:3.0:1788863701.079443:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323987840 00000100:00100000:3.0:1788863701.079470:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323987584 00000100:00100000:3.0:1788863701.079472:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323987584 00000100:00100000:3.0:1788863701.079489:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788863701.079495:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323987840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.079533:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323987840:12345-0@lo:400:kworker.0 Request processed in 38us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863701.079540:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788863701.079550:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788863701.079556:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323987584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863701.080391:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323987456:0@lo:400:kworker.0 00000100:00100000:2.0:1788863701.080426:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323987968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863701.080468:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863701.080801:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323987584:12345-0@lo:400:kworker.0 Request processed in 1244us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863701.080809:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788863701.080843:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323987200 00010000:00080000:2.0:1788863701.081045:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd28d3480 x1875759323987584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863701.081058:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323987584:0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.081194:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323987200 00000100:00100000:2.0:1788863701.081276:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323987968 00000100:00100000:2.0:1788863701.081281:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323987968 00000100:00100000:2.0:1788863701.081365:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788863701.081375:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323987968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863701.081416:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863701.081473:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323987968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863701.081480:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788863701.081517:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788863701.081525:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759323987200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.081561:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759323987200:12345-0@lo:400:kworker.0 Request processed in 37us (2921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863701.081567:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:3.0:1788863701.081672:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863701.081678:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863701.081680:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863701.081902:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323987200:0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.081919:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323987712:0@lo:400:kworker.0 00000100:00100000:3.0:1788863701.081932:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323987328:0@lo:400:kworker.0 00010000:00080000:3.0:1788863701.081960:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bd01a9180 x1875759323987840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863701.081970:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323987840:0@lo:400:kworker.0 00010000:00080000:3.0:1788863701.082019:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff176300 x1875759323987968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863701.082034:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323987968:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788863701.670750:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 93b25027-f4fd-4c57-8714-3a69d8e44d8a 00000020:00000080:2.0:1788863701.670763:0:7637:0:(genops.c:885:class_export_put()) final put ffff8e8becca6000/93b25027-f4fd-4c57-8714-3a69d8e44d8a 00000020:00000080:1.0:1788863701.670811:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8becca6000/93b25027-f4fd-4c57-8714-3a69d8e44d8a for lustre-OST0001 00000020:00000080:1.0:1788863701.671436:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8becca0800 for lustre-OST0001 00010000:00010000:2.0:1788863701.974744:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788863702.643154:0:11018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788863702.846636:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863702.846689:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863702.846705:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298787584 00000100:00100000:1.0:1788863702.846718:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298787584 00000100:00100000:3.0:1788863702.846731:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863702.846762:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298787712 00000100:00100000:3.0:1788863702.846767:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298787712 00000100:00100000:1.0:1788863702.846801:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:3.0:1788863702.846810:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:1.0:1788863702.846816:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298787584:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863702.846823:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298787712:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863702.846930:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298787584:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 119us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863702.846937:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00080000:1.0:1788863702.846961:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863702.849017:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298787456 00000100:00100000:2.0:1788863702.849035:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298787456 00000100:00100000:2.0:1788863702.849115:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:2.0:1788863702.849128:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298787456:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863702.850798:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298787712:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 3965us (4053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863702.850815:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:2.0:1788863702.853769:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298787456:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 4628us (7062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863702.853784:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 228 00010000:00010000:3.0:1788863702.998178:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863703.126610:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323988096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863703.126771:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863703.127288:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323988096 00000100:00100000:1.0:1788863703.127310:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323988096 00000100:00100000:1.0:1788863703.127386:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788863703.127396:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323988096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863703.127438:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788863703.128253:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863703.128871:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323988096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1455us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863703.128883:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788863703.129004:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff175880 x1875759323988096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863703.129032:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323988096:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788863704.022248:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863705.046196:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863706.073771:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863706.205280:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323988352:0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.205390:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863706.205472:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323988864:0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.205507:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863706.205553:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788863706.205559:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323988224:0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.205597:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863706.205620:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323988736:0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.205645:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863706.205690:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323988480:0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.205755:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863706.205780:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863706.205785:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323988608:0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.205809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863706.205906:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323988352 00000100:00100000:0.0:1788863706.205917:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323988352 00000100:00100000:0.0:1788863706.205973:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323988736 00000100:00100000:0.0:1788863706.205976:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323988736 00000100:00100000:0.0:1788863706.206009:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323988480 00000100:00100000:0.0:1788863706.206012:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323988480 00000100:00100000:0.0:1788863706.206030:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788863706.206039:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323988352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.206111:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759323988352:12345-0@lo:400:kworker.0 Request processed in 71us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863706.206119:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788863706.206153:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788863706.206162:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323988736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.206192:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759323988736:12345-0@lo:400:kworker.0 Request processed in 33us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863706.206199:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788863706.206211:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788863706.206218:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323988480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.206265:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323988480:12345-0@lo:400:kworker.0 Request processed in 47us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863706.206272:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788863706.206295:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323988864 00000100:00100000:0.0:1788863706.206299:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323988864 00000100:00100000:0.0:1788863706.206328:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323988608 00000100:00100000:0.0:1788863706.206331:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323988608 00000100:00100000:0.0:1788863706.206353:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788863706.206359:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323988864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.206393:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323988864:12345-0@lo:400:kworker.0 Request processed in 35us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863706.206401:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788863706.206413:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788863706.206418:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323988608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.206446:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323988608:12345-0@lo:400:kworker.0 Request processed in 28us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863706.206454:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788863706.206475:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323988224 00000100:00100000:0.0:1788863706.206479:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323988224 00000100:00100000:0.0:1788863706.206505:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788863706.206521:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759323988224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.206554:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759323988224:12345-0@lo:400:kworker.0 Request processed in 35us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863706.206562:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:0.0:1788863706.206619:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863706.206624:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863706.206627:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788863706.206677:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee551500 x1875759323988608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863706.206699:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323988608:0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.206713:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323988480:0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.206764:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759323988224:0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.206775:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759323988736:0@lo:400:kworker.0 00000100:00100000:0.0:1788863706.206789:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759323988352:0@lo:400:kworker.0 00010000:00080000:0.0:1788863706.206802:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee553800 x1875759323988864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863706.206812:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323988864:0@lo:400:kworker.0 00000100:00100000:2.0:1788863706.207116:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863706.207131:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323988992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863706.207183:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863706.207231:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323988992 00000100:00100000:2.0:1788863706.207247:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323988992 00000100:00100000:2.0:1788863706.207288:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788863706.207296:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323988992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863706.207333:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863706.207372:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323988992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863706.207379:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788863706.207412:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bee225c00 x1875759323988992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863706.207427:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323988992:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788863706.731039:0:11166:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff48a16a10 20000000:00000080:0.0:1788863706.731068:0:11166:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8bff770000 uarg=0000000000000000 20000000:01000000:0.0:1788863706.731123:0:11166:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788863706.731131:0:11166:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788863706.731138:0:11166:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788863706.732374:0:11167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788863706.732597:0:11166:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788863706.742140:0:11166:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788863706.742185:0:11166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.742211:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bf4e7b800/0x744cd7666bbbab98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbab91 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.742222:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbaba6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbab9f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.742242:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbbabb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbabad expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.742277:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbabbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330da5 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.742286:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbabd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ddd expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.742294:0:11166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.742360:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbabd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ddd expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.742379:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbabd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ddd expref: 12 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863706.742398:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee225c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875759323989120:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863706.743212:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbabbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330da5 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.743239:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbabbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330da5 expref: 12 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863706.743252:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee225500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875759323989248:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863706.743556:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbbabb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbabad expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.743572:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbbabb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbabad expref: 18 pid: 5832 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863706.743607:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee225f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875759323989376:0@lo:104: 00000100:00100000:2.0:1788863706.743676:0:11166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863706.743716:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbaba6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbab9f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.743725:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbaba6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbab9f expref: 18 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863706.743735:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee227b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875759323989504:0@lo:104: 00000100:00100000:2.0:1788863706.743758:0:11166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863706.743783:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bf4e7b800/0x744cd7666bbbab98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbab91 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.743791:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bf4e7b800/0x744cd7666bbbab98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbab91 expref: 18 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863706.743800:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee226300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875759323989632:0@lo:104: 00000100:00100000:2.0:1788863706.743824:0:11166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863706.743836:0:11166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc7660840 going to sleep for 11 seconds 00000100:00100000:3.0:1788863706.743968:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323989376 00000100:00100000:3.0:1788863706.743979:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323989376 00000100:00100000:3.0:1788863706.744033:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323989504 00000100:00100000:3.0:1788863706.744038:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323989504 00000100:00100000:3.0:1788863706.744048:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323989632 00000100:00100000:3.0:1788863706.744050:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323989632 00000100:00100000:3.0:1788863706.744063:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788863706.744074:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+5:11166:x1875759323989376:12345-0@lo:104: 00010000:00010000:3.0:1788863706.744091:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbabb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744165:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788863706.744172:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+5:11166:x1875759323989376:12345-0@lo:104: Request processed in 100us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863706.744180:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788863706.744202:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788863706.744208:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+4:11166:x1875759323989504:12345-0@lo:104: 00010000:00010000:3.0:1788863706.744217:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaba6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744267:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788863706.744272:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+4:11166:x1875759323989504:12345-0@lo:104: Request processed in 66us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863706.744278:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788863706.744289:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788863706.744293:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:11166:x1875759323989632:12345-0@lo:104: 00010000:00010000:3.0:1788863706.744312:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbab98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744347:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788863706.744352:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:11166:x1875759323989632:12345-0@lo:104: Request processed in 59us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863706.744358:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788863706.744377:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788863706.744383:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbabb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744391:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16e00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863706.744396:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbabb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744408:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbabb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863706.744417:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbabb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863706.744423:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863706.744463:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbabb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744472:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863706.744501:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbabb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744509:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbabb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744537:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788863706.744540:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbaba6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744546:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031200 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863706.744549:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbaba6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744555:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbaba6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863706.744562:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbaba6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863706.744566:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863706.744579:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaba6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744585:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863706.744601:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaba6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744607:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031200/0x744cd7666bbbab9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbaba6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744616:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863706.744619:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbab98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744634:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0030e00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863706.744637:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbab98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744644:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbab98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863706.744650:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbab98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863706.744655:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863706.744666:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbab98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744671:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863706.744679:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbab98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744685:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030e00/0x744cd7666bbbab91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbab98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.744700:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863706.744702:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863706.744704:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863706.744712:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863706.744718:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863706.744744:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323989760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863706.744784:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863706.744823:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323989888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863706.744883:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863706.744907:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863706.744913:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323990016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863706.744935:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863706.744970:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323989760 00000100:00100000:3.0:1788863706.744976:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323989760 00010000:00010000:3.0:1788863706.745002:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbbabb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbabad expref: 19 pid: 5832 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863706.745027:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323989888 00000100:00100000:3.0:1788863706.745031:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323989888 00010000:00010000:3.0:1788863706.745041:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbaba6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbab9f expref: 20 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863706.745051:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323990016 00000100:00100000:3.0:1788863706.745054:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323990016 00010000:00010000:3.0:1788863706.745064:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bf4e7b800/0x744cd7666bbbab98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbab91 expref: 21 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863706.745075:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788863706.745081:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2887850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+21:3307:x1875759323989760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863706.745094:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863706.745099:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbbabb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbabad expref: 21 pid: 5832 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.745110:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbbabb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbabad expref: 21 pid: 5832 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.745130:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863706.745158:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2887850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+21:3307:x1875759323989760:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863706.745171:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788863706.745237:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788863706.745244:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+20:3308:x1875759323989888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863706.745251:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863706.745257:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbaba6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbab9f expref: 20 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.745267:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbaba6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbab9f expref: 20 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.745279:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863706.745305:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+20:3308:x1875759323989888:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863706.745311:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788863706.745323:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788863706.745329:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323990016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863706.745336:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863706.745340:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bf4e7b800/0x744cd7666bbbab98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbab91 expref: 19 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.745348:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bf4e7b800/0x744cd7666bbbab98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbab91 expref: 19 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.745357:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863706.745377:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323990016:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863706.745383:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788863706.745436:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323989760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863706.745472:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323990016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863706.745479:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323989888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863706.745737:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8c021c7e00/0x744cd7666bbbabb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbabad expref: 18 pid: 5832 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863706.745757:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee225f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875759323989376:0@lo:104: 00010000:00010000:2.0:1788863706.745769:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbaba6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbab9f expref: 17 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863706.745777:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee227b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875759323989504:0@lo:104: 00010000:00010000:2.0:1788863706.745788:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7b800/0x744cd7666bbbab98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbab91 expref: 16 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863706.745805:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee226300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875759323989632:0@lo:104: 00000100:00100000:2.0:1788863706.750128:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee225c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875759323989120:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863706.750154:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee225500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875759323989248:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863706.750206:0:11166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863706.752132:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863706.752526:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298787840 00000100:00100000:3.0:1788863706.752542:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298787840 00010000:00010000:3.0:1788863706.752617:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbabd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ddd expref: 13 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863706.752674:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:3.0:1788863706.752685:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298787840:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863706.752709:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863706.752716:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbabd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ddd expref: 13 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.752733:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbabd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ddd expref: 13 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.752754:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbabd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ddd expref: 13 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.752773:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863706.752867:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:2351:x1875759298787840:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 167us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863706.752876:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1788863706.754305:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863706.754405:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298787968 00000100:00100000:3.0:1788863706.754417:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298787968 00010000:00010000:3.0:1788863706.754533:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbabbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330da5 expref: 12 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863706.754638:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1788863706.754649:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:2350:x1875759298787968:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863706.754668:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863706.754675:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbabbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330da5 expref: 12 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.754690:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbabbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330da5 expref: 12 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.755658:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbabbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330da5 expref: 12 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.755689:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.755817:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.755846:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.756134:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.756143:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.756151:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.756177:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555600 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863706.756183:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.756193:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.756261:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.756273:0:11166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863706.756277:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863706.756288:0:11166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863706.756297:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbabec lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863706.756375:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:2350:x1875759298787968:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1724us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863706.756387:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00010000:00010000:3.0:1788863707.094156:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863707.964945:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863707.964985:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863707.965016:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863707.965048:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298788352 00000100:00100000:2.0:1788863707.965060:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298788352 00000100:00100000:2.0:1788863707.965118:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298788224 00000100:00100000:2.0:1788863707.965120:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298788224 00000100:00100000:2.0:1788863707.965144:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:2.0:1788863707.965154:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298788352:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863707.965249:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298788352:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863707.965256:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:2.0:1788863707.965291:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:2.0:1788863707.965297:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298788224:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863707.965320:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298788224:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863707.965326:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00080000:2.0:1788863707.965344:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863707.965999:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298788096 00000100:00100000:3.0:1788863707.966009:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298788096 00000100:00100000:3.0:1788863707.966051:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 230 00000100:00100000:3.0:1788863707.966058:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:2350:x1875759298788096:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863707.966093:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:2350:x1875759298788096:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 36us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863707.966099:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 230 00010000:00010000:3.0:1788863708.122457:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788863708.245946:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788863708.245955:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bd2b49800 from 7 10000000:01000000:3.0:1788863708.245960:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788863708.246017:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863708.246042:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863708.246056:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863708.246084:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323990144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863708.246157:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863708.246232:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfb539600 going to sleep for 11 seconds 00000100:00100000:0.0:1788863708.246410:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323990144 00000100:00100000:0.0:1788863708.246426:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323990144 00000100:00100000:0.0:1788863708.246485:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788863708.246495:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323990144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863708.246512:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863708.246527:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbbabfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbabf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863708.246552:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbbabfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbabf3 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863708.246667:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbbabfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbabf3 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863708.246677:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030200, rc 0) 00000100:00100000:0.0:1788863708.246722:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323990144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863708.246730:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788863708.246833:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323990144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863708.246849:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbabfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863708.246880:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbabfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863708.246942:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323990272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863708.246970:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863708.247265:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfb539600 going to sleep for 11 seconds 00000100:00100000:3.0:1788863708.248658:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323990400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863708.248714:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863708.248910:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323990400 00000100:00100000:2.0:1788863708.248919:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323990400 00000100:00100000:2.0:1788863708.248979:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788863708.248991:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323990400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863708.249030:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863708.249076:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323990400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863708.249083:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788863708.249146:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788863708.249175:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff176d80 x1875759323990400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863708.249206:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323990400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863708.249365:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323990272 00000100:00100000:0.0:1788863708.249371:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323990272 00000100:00100000:0.0:1788863708.249453:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788863708.249461:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323990272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863708.251389:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323990272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1914us (4403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863708.251406:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788863708.251818:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323990272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863708.251900:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee226300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323990528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863708.251952:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863708.251979:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc7660a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863708.253707:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323990528 00000100:00100000:0.0:1788863708.253724:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323990528 00000100:00100000:0.0:1788863708.253798:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788863708.253809:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323990528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863708.254175:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323990528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 366us (2221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863708.254183:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788863708.254270:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee226300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323990528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788863708.257744:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788863708.258452:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788863708.258485:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788863708.258502:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbabfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863708.258515:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbabfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863708.258528:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788863708.258532:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bde7ad800 from 7 10000000:01000000:1.0:1788863708.258535:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788863708.259671:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863708.259684:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863708.259697:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863708.259725:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323990656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788863708.259790:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863708.259830:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd1e153c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863708.260319:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323990656 00000100:00100000:0.0:1788863708.260327:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323990656 00000100:00100000:0.0:1788863708.260369:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788863708.260378:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323990656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863708.260393:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863708.260413:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbac08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbac01 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863708.260440:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbac08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbac01 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863708.260451:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbac08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbac01 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863708.260460:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030000, rc 0) 00000100:00100000:0.0:1788863708.260509:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323990656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863708.260517:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788863708.260711:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323990656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863708.260726:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbac08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863708.260750:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbac08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863708.260822:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323990784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863708.263683:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863708.263747:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd1e153c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863708.269682:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323990784 00000100:00100000:2.0:1788863708.269703:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323990784 00000100:00100000:2.0:1788863708.269774:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788863708.269787:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323990784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863708.271366:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323990784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1570us (7681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863708.271382:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788863708.271686:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323990784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863708.271750:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323990912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863708.271800:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863708.271873:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbbd03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863708.272079:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323990912 00000100:00100000:2.0:1788863708.272086:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323990912 00000100:00100000:2.0:1788863708.272132:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788863708.272141:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323990912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863708.272472:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323990912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 331us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863708.272479:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788863708.272556:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323990912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788863708.278814:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788863708.289624:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788863708.289675:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788863708.289687:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbac08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863708.289703:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbac08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863708.289716:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788863708.289718:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bd56cb800 from 7 10000000:01000000:2.0:1788863708.289721:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788863708.289774:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863708.289783:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863708.289797:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863708.289832:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee227b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323991040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788863708.289946:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863708.289998:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc7660180 going to sleep for 11 seconds 00000100:00100000:0.0:1788863708.292955:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323991040 00000100:00100000:0.0:1788863708.292971:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323991040 00000100:00100000:0.0:1788863708.293052:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788863708.293062:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323991040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863708.293080:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863708.293100:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc0030e00/0x744cd7666bbbac16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbac0f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863708.293130:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc0030e00/0x744cd7666bbbac16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbac0f expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863708.293141:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc0030e00/0x744cd7666bbbac16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbac0f expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863708.293151:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030e00, rc 0) 00000100:00100000:0.0:1788863708.293241:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323991040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (3295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863708.293253:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788863708.298076:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee227b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323991040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863708.298119:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbac16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863708.298135:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbac16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863708.298256:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323991168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863708.298330:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863708.298386:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfb539cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863708.298902:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323991168 00000100:00100000:0.0:1788863708.298913:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323991168 00000100:00100000:0.0:1788863708.298966:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788863708.298978:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323991168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863708.299287:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323991168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863708.299295:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788863708.299809:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323991168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863708.299871:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323991296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863708.300212:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863708.300249:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfb539cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863708.302635:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323991296 00000100:00100000:0.0:1788863708.302650:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323991296 00000100:00100000:0.0:1788863708.302728:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788863708.302739:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323991296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863708.303516:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323991296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 777us (3301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863708.303526:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788863708.310240:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323991296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788863708.314720:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788863708.314844:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788863708.315053:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863708.315066:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbac16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863708.315077:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbac16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863708.742619:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863708.744308:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298788480 00000100:00100000:1.0:1788863708.744329:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298788480 00000100:00100000:1.0:1788863708.744415:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 240 00000100:00100000:1.0:1788863708.744432:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:5595:x1875759298788480:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863708.744459:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863708.744488:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbac1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e07 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863708.744527:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbac1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e07 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863708.744539:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbac1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e07 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863708.744551:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7aa00, rc 0) 00000100:00100000:1.0:1788863708.744661:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:5595:x1875759298788480:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 232us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863708.744668:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 240 00000100:00100000:2.0:1788863708.759448:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863708.759624:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298788608 00000100:00100000:0.0:1788863708.759648:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298788608 00000100:00100000:0.0:1788863708.759912:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 241 00000100:00100000:0.0:1788863708.759932:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:5595:x1875759298788608:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863708.761031:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:5595:x1875759298788608:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 1089us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863708.761377:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 241 00000100:00100000:2.0:1788863708.767633:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863708.768480:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298788736 00000100:00100000:3.0:1788863708.768819:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298788736 00000100:00100000:2.0:1788863708.769102:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 242 00000100:00100000:2.0:1788863708.769126:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:5595:x1875759298788736:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863708.769673:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:5595:x1875759298788736:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 554us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863708.769686:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 242 00000100:00100000:2.0:1788863708.785114:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863708.785742:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298788864 00000100:00100000:1.0:1788863708.785759:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298788864 00000100:00100000:1.0:1788863708.785843:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 243 00000100:00100000:1.0:1788863708.785882:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:5595:x1875759298788864:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863708.785909:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863708.785935:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7a200/0x744cd7666bbbac24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e0e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863708.785974:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7a200/0x744cd7666bbbac24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e0e expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863708.785987:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7a200/0x744cd7666bbbac24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e0e expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863708.785998:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a200, rc 0) 00000100:00100000:1.0:1788863708.786081:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:5595:x1875759298788864:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 204us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863708.786089:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 243 00000100:00100000:0.0:1788863708.788695:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863708.789156:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298788992 00000100:00100000:3.0:1788863708.789171:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298788992 00000100:00100000:3.0:1788863708.789254:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 244 00000100:00100000:3.0:1788863708.789266:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:5595:x1875759298788992:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863708.789667:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:5595:x1875759298788992:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 401us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863708.789677:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 244 00000100:00100000:0.0:1788863708.797876:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863708.797930:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298789120 00000100:00100000:0.0:1788863708.797944:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298789120 00000100:00100000:0.0:1788863708.798014:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 245 00000100:00100000:0.0:1788863708.798026:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:5595:x1875759298789120:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863708.798421:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:5595:x1875759298789120:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 395us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863708.798433:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 245 00010000:00010000:2.0:1788863709.142403:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863710.166234:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863711.190266:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863711.320783:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323991424:0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.320885:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863711.320938:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759323991936:0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.321008:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863711.321040:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863711.321046:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323991808:0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.321082:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863711.321116:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323991552:0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.321153:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863711.321172:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323992064:0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.321213:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863711.321237:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863711.321242:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323991680:0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.321266:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863711.321302:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323991424 00000100:00100000:3.0:1788863711.321314:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323991424 00000100:00100000:2.0:1788863711.326706:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323991936 00000100:00100000:2.0:1788863711.326724:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323991936 00000100:00100000:2.0:1788863711.326796:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323991552 00000100:00100000:2.0:1788863711.326798:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323991552 00000100:00100000:2.0:1788863711.326817:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323991680 00000100:00100000:2.0:1788863711.326819:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323991680 00000100:00100000:2.0:1788863711.326838:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788863711.326845:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759323991936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863711.326963:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759323991936:12345-0@lo:400:kworker.0 Request processed in 117us (5954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863711.326969:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788863711.326986:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788863711.326992:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323991552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863711.327027:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323991552:12345-0@lo:400:kworker.0 Request processed in 36us (5874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863711.327034:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788863711.327045:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788863711.328131:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863711.328164:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323991808 00000100:00100000:3.0:1788863711.328173:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323991808 00000100:00100000:3.0:1788863711.328238:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323992064 00000100:00100000:3.0:1788863711.328241:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323992064 00000100:00100000:3.0:1788863711.328260:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788863711.328266:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323991808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.328326:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323991808:12345-0@lo:400:kworker.0 Request processed in 60us (7243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863711.328332:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788863711.328344:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788863711.328349:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323992064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.328371:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323992064:12345-0@lo:400:kworker.0 Request processed in 23us (7159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863711.328376:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788863711.328391:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863711.328394:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863711.328501:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323991552:0@lo:400:kworker.0 00010000:00080000:3.0:1788863711.328514:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff744380 x1875759323992064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863711.328525:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323992064:0@lo:400:kworker.0 00010000:00080000:3.0:1788863711.328556:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff745c00 x1875759323991808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863711.328564:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323991808:0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.328576:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759323991936:0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.328615:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788863711.328622:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759323991424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.328662:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759323991424:12345-0@lo:400:kworker.0 Request processed in 41us (7780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863711.328668:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788863711.328697:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323991424:0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.330525:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863711.330547:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323992192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863711.330611:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863711.330676:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323992192 00000100:00100000:3.0:1788863711.330684:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323992192 00000100:00100000:3.0:1788863711.330730:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788863711.330739:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323992192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863711.330774:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863711.330817:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323992192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863711.330824:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788863711.330970:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bca961500 x1875759323992192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863711.330989:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323992192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863711.331352:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323991680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863711.335433:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323991680:12345-0@lo:400:kworker.0 Request processed in 8351us (14152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863711.335451:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788863711.335556:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323991680:0@lo:400:kworker.0 00000001:02000400:2.0:1788863711.381306:0:11364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788863712.214980:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863713.087653:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863713.087694:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863713.087730:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863713.087772:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298789504 00000100:00100000:2.0:1788863713.087788:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298789504 00000100:00100000:2.0:1788863713.087876:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298789376 00000100:00100000:2.0:1788863713.087880:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298789376 00000100:00100000:2.0:1788863713.087905:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:2.0:1788863713.087914:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298789504:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863713.088004:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298789504:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863713.088012:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:2.0:1788863713.088033:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:2.0:1788863713.088039:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298789376:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863713.088064:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298789376:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863713.088070:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00080000:2.0:1788863713.088116:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863713.088344:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298789248 00000100:00100000:0.0:1788863713.088349:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298789248 00000100:00100000:0.0:1788863713.088390:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 247 00000100:00100000:0.0:1788863713.088397:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298789248:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863713.088455:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298789248:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 58us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863713.088462:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 247 00010000:00010000:2.0:1788863713.242707:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863713.367692:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863713.367718:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323992320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863713.367797:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863713.367902:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323992320 00000100:00100000:1.0:1788863713.367913:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323992320 00000100:00080000:2.0:1788863713.367968:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863713.367982:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788863713.367993:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323992320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863713.368027:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863713.368353:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323992320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 361us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863713.368370:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788863713.368524:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff175180 x1875759323992320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863713.368551:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323992320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863714.264554:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863715.291037:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863715.572369:0:11464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 06:35:13 (1788863713) === 00000100:00100000:3.0:1788863715.846638:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863715.846685:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863715.846737:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298789760 00000100:00100000:3.0:1788863715.846764:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298789760 00000100:00100000:3.0:1788863715.846833:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1788863715.846846:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:9681:x1875759298789760:12345-192.168.204.51@tcp:700:mkdir.0 00000100:00100000:3.0:1788863715.846987:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:9681:x1875759298789760:12345-192.168.204.51@tcp:700:mkdir.0 Request processed in 142us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863715.846994:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1788863715.847026:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298789632 00000100:00100000:3.0:1788863715.847030:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298789632 00000100:00100000:3.0:1788863715.847069:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1788863715.847076:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298789632:12345-192.168.204.51@tcp:41:mkdir.0 00000004:00000024:3.0:1788863715.847111:0:6707:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788863715.847163:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298789632:12345-192.168.204.51@tcp:41:mkdir.0 Request processed in 87us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863715.847169:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00080000:3.0:1788863715.847189:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863715.857627:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863715.861612:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298790016 00000100:00100000:2.0:1788863715.861637:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298790016 00000100:00100000:2.0:1788863715.861751:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:2.0:1788863715.861764:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:9681:x1875759298790016:12345-192.168.204.51@tcp:36:mkdir.0 00010000:00010000:2.0:1788863715.861914:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863715.862092:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc13a0200/0x744cd7666bbbab0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d90 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.862125:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bd4f5a200) 00010000:00010000:2.0:1788863715.862137:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863715.863697:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbac2b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.863723:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbac2b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.863738:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbac2b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.863793:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac32 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.863802:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.863809:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863715.867265:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788863715.867290:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbac2b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.867302:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbac2b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.867309:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbac2b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.867315:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863715.867319:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbac2b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.867328:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbac2b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.867344:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:2.0:1788863715.867348:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863715.867352:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbac2b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.867359:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbac2b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863715.867382:0:9496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd8bc371 reply state 000000009871e9ec transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863715.867391:0:9496:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863715.867927:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:9681:x1875759298790016:12345-192.168.204.51@tcp:36:mkdir.0 Request processed in 5753us (12263us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788863715.867950:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00010000:00010000:2.0:1788863715.881765:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.881786:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac32 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.881794:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac32 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.881801:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863715.881806:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac32 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.881816:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac32 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.881838:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e8bc9330800) 00010000:00010000:2.0:1788863715.881841:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863715.881847:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac32 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.881870:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac32 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863715.891492:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863715.891557:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298790144 00000100:00100000:2.0:1788863715.891569:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298790144 00000100:00100000:2.0:1788863715.891639:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1788863715.891651:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:9682:x1875759298790144:12345-192.168.204.51@tcp:101:chmod.0 00010000:00010000:2.0:1788863715.891676:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863715.891717:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.891791:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.891806:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.891819:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863715.891894:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788863715.891898:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863715.891939:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.891964:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e15 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.891981:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e15 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.891989:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330400) 00010000:00010000:2.0:1788863715.891992:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863715.891996:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555e00, rc 0) 00000100:00100000:2.0:1788863715.892069:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:9682:x1875759298790144:12345-192.168.204.51@tcp:101:chmod.0 Request processed in 420us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863715.892077:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1788863715.895283:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863715.895364:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298790400 00000100:00100000:3.0:1788863715.895382:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298790400 00000100:00100000:3.0:1788863715.895457:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1788863715.895484:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:9682:x1875759298790400:12345-192.168.204.51@tcp:36:chmod.0 00010000:00010000:3.0:1788863715.895569:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863715.895612:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e15 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.895636:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330400) 00010000:00010000:3.0:1788863715.895653:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863715.895692:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac47 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.895728:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac47 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.895740:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac47 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863715.896405:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cbd7dc1 reply state 0000000029d1ba79 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac47 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863715.896420:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788863715.896431:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788863715.896775:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:9682:x1875759298790400:12345-192.168.204.51@tcp:36:chmod.0 Request processed in 1293us (1503us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788863715.896785:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00010000:00010000:1.0:1788863715.905302:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac47 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.905325:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac47 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.905335:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac47 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.905341:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863715.905347:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac47 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.905354:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac47 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.905372:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015d00) 00010000:00010000:1.0:1788863715.905376:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788863715.905381:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac47 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863715.905398:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac47 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863715.943073:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863715.943260:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298790528 00000100:00100000:2.0:1788863715.943279:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298790528 00000100:00100000:2.0:1788863715.943400:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1788863715.943412:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:9683:x1875759298790528:12345-192.168.204.51@tcp:101:chown.0 00010000:00010000:2.0:1788863715.943440:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863715.943466:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e1c expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.943539:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.943552:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.943564:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863715.943598:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788863715.943601:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863715.943637:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.943661:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e1c expref: 9 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.943680:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e1c expref: 8 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.943688:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330800) 00010000:00010000:2.0:1788863715.943691:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863715.943695:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554e00, rc 0) 00000100:00100000:2.0:1788863715.943769:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:9683:x1875759298790528:12345-192.168.204.51@tcp:101:chown.0 Request processed in 359us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863715.943776:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1788863715.951219:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863715.951339:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298790656 00000100:00100000:3.0:1788863715.951356:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298790656 00000100:00100000:3.0:1788863715.951443:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1788863715.951454:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:9683:x1875759298790656:12345-192.168.204.51@tcp:101:chown.0 00010000:00010000:3.0:1788863715.951620:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863715.951654:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbac5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e23 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.951732:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbac63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.951746:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbac63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.951758:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbac63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.951788:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbac6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.951795:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbac6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.951801:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbac6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952141:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952149:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952158:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863715.952194:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788863715.952198:0:6707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863715.952219:0:6707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952233:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbac63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952242:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbac63 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952249:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbac63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952255:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863715.952258:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbac63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952266:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbac63 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952286:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330800) 00010000:00010000:2.0:1788863715.952289:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863715.952295:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbac63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952302:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbac63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952317:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbac6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952325:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbac6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952330:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbac6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952335:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863715.952337:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbac6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952343:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbac6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952349:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e8bc3015200) 00010000:00010000:2.0:1788863715.952352:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863715.952355:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbac6a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952360:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbac6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952404:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbac5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e23 expref: 10 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952420:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e23 expref: 9 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863715.952427:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:2.0:1788863715.952429:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863715.952431:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554600, rc 0) 00000100:00100000:2.0:1788863715.952584:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:9683:x1875759298790656:12345-192.168.204.51@tcp:101:chown.0 Request processed in 1130us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863715.952594:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1788863715.963252:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863715.974890:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298790912 00000100:00100000:3.0:1788863715.974906:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298790912 00000100:00100000:3.0:1788863715.975008:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:3.0:1788863715.975019:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:9683:x1875759298790912:12345-192.168.204.51@tcp:36:chown.0 00010000:00010000:3.0:1788863715.975088:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863715.975120:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e23 expref: 9 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.975141:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:3.0:1788863715.975154:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863715.975183:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.975198:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863715.975207:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863716.014294:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024bf5f33 reply state 00000000994fa54f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863716.014327:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788863716.014352:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788863716.014611:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:9683:x1875759298790912:12345-192.168.204.51@tcp:36:chown.0 Request processed in 39585us (51361us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788863716.014623:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000001:00080000:1.0:1788863716.014759:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1788863716.014801:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1788863716.014934:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.014946:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.014955:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.014962:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863716.014969:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.014978:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.015003:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8bc3015700) 00010000:00010000:0.0:1788863716.015006:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788863716.015013:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.015056:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbac78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863716.037607:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863716.038177:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298791040 00000100:00100000:2.0:1788863716.038197:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298791040 00000100:00100000:2.0:1788863716.038314:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:2.0:1788863716.038329:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:9684:x1875759298791040:12345-192.168.204.51@tcp:101:touch.500 00010000:00010000:2.0:1788863716.038375:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863716.038434:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbac7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e2a expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788863716.043637:0:9496:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5107us 00010000:00010000:2.0:1788863716.078119:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.078165:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.078184:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.078217:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.078225:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.078231:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082170:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbac94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082211:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbac94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082235:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbac94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863716.082303:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788863716.082309:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863716.082380:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbac94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082402:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082412:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082420:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082461:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863716.082467:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082478:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082497:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330800) 00010000:00010000:2.0:1788863716.082501:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863716.082510:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082518:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbac86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082544:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082550:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082557:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082564:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863716.082567:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082573:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082595:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e8bc9330a00) 00010000:00010000:2.0:1788863716.082598:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863716.082602:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082609:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbac8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082680:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbac7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e2a expref: 8 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082700:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbac94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e2a expref: 7 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.082709:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:2.0:1788863716.082712:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788863716.082715:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554800, rc 0) 00000100:00100000:2.0:1788863716.082911:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:9684:x1875759298791040:12345-192.168.204.51@tcp:101:touch.500 Request processed in 44582us (45319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863716.082925:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788863716.093103:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863716.093264:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298791296 00000100:00100000:0.0:1788863716.093283:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298791296 00000100:00100000:0.0:1788863716.093399:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:0.0:1788863716.093414:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:9684:x1875759298791296:12345-192.168.204.51@tcp:101:touch.500 00010000:00010000:0.0:1788863716.093451:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863716.093490:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbac9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e31 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.094262:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaca2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.094291:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaca2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.094308:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaca2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.101342:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaca9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.101376:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.101395:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788863716.113406:0:6707:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788863716.114290:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbacb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863716.114314:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbacb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863716.114333:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbacb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863716.114777:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaca2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863716.114789:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaca2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863716.114796:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaca2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863716.114804:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863716.114809:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaca2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863716.114819:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaca2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863716.114835:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:1.0:1788863716.114839:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863716.115221:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaca2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863716.115230:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaca2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863716.115254:0:6707:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae0bb725 reply state 000000002da00b98 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863716.115266:0:6707:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788863716.115316:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbac9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e31 expref: 10 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863716.115334:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbacb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e31 expref: 9 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863716.115342:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8bd20dd900) 00010000:00010000:1.0:1788863716.115345:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863716.115348:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b400, rc 0) 00000100:00100000:1.0:1788863716.116256:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:9684:x1875759298791296:12345-192.168.204.51@tcp:101:touch.500 Request processed in 22836us (23170us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788863716.116272:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00010000:00010000:0.0:1788863716.119795:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.119914:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaca9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.119924:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.119935:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863716.119945:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.119959:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaca9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.119990:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3e0961b7 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863716.119994:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863716.120000:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaca9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.120008:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaca9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863716.125027:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863716.125297:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298791552 00000100:00100000:0.0:1788863716.125315:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298791552 00000100:00100000:0.0:1788863716.125421:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:0.0:1788863716.125450:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:9684:x1875759298791552:12345-192.168.204.51@tcp:36:touch.500 00010000:00010000:0.0:1788863716.125561:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863716.125616:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbacb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e31 expref: 9 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.125671:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8bd20dd900) 00010000:00010000:0.0:1788863716.125685:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863716.125779:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbacbe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.125799:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbacbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.125813:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbacbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863716.126086:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056665843 reply state 00000000f45c3b72 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbacbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863716.126098:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863716.126291:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:9684:x1875759298791552:12345-192.168.204.51@tcp:36:touch.500 Request processed in 839us (1276us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788863716.126302:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00010000:00010000:2.0:1788863716.130216:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbacbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.130236:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbacbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.130246:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbacbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.130276:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863716.130282:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbacbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.130291:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbacbe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.130312:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:2.0:1788863716.130316:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863716.130321:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbacbe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.130328:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbacbe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863716.134266:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863716.134561:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298791680 00000100:00100000:2.0:1788863716.134584:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298791680 00000100:00100000:2.0:1788863716.134816:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:2.0:1788863716.134830:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:9684:x1875759298791680:12345-192.168.204.51@tcp:101:touch.500 00010000:00010000:2.0:1788863716.134892:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863716.134924:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbacc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e38 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.135017:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbacc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e38 expref: 10 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.135036:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbacc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e38 expref: 10 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.135107:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:2.0:1788863716.135111:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863716.135115:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555e00, rc 0) 00000100:00100000:2.0:1788863716.135210:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:9684:x1875759298791680:12345-192.168.204.51@tcp:101:touch.500 Request processed in 383us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863716.135218:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:1.0:1788863716.139830:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863716.140755:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298791808 00000100:00100000:3.0:1788863716.140781:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298791808 00000100:00100000:3.0:1788863716.141021:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1788863716.141033:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1875759298791808:12345-192.168.204.51@tcp:8:touch.500 00010000:00080000:3.0:1788863716.141318:0:6680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp t0 exp 0000000000000000 cur 345 last 0 00000020:00000080:3.0:1788863716.141368:0:6680:0:(genops.c:1384:class_connect()) connect: client 6fd3bcef-c680-4c25-aae1-ecd03903ad0a, cookie 0x744cd7666bbbaccc 00002000:00100000:3.0:1788863716.141520:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6fd3bcef-c680-4c25-aae1-ecd03903ad0a/ffff8e8bf4f1d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788863716.141566:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788863716.142017:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788863716.142076:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8e8bf4f1e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863716.142185:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2349:x1875759298791808:12345-192.168.204.51@tcp:8:touch.500 Request processed in 1151us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863716.142197:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:0.0:1788863716.148455:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863716.148564:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298791936 00000100:00100000:3.0:1788863716.148579:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298791936 00000100:00080000:2.0:1788863716.148663:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863716.148719:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1788863716.148732:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:0:x1875759298791936:12345-192.168.204.51@tcp:2:touch.500 00000001:00080000:0.0:1788863716.209337:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1788863716.209360:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000100:00100000:3.0:1788863716.209686:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:0:x1875759298791936:12345-192.168.204.51@tcp:2:touch.500 Request processed in 60951us (61240us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788863716.209698:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1788863716.215530:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863716.215654:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298792192 00000100:00100000:1.0:1788863716.215666:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298792192 00000100:00100000:1.0:1788863716.215736:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1788863716.215747:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:9684:x1875759298792192:12345-192.168.204.51@tcp:35:touch.500 00000100:00100000:1.0:1788863716.216218:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+11:9684:x1875759298792192:12345-192.168.204.51@tcp:35:touch.500 Request processed in 472us (700us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788863716.216247:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1788863716.235013:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863716.236885:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298792320 00000100:00100000:2.0:1788863716.236901:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298792320 00000100:00100000:2.0:1788863716.237610:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:2.0:1788863716.237683:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+11:9685:x1875759298792320:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:2.0:1788863716.237719:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863716.237746:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbacd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.237830:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbacda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.237846:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbacda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.237893:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbacda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863716.237941:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788863716.237945:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863716.238282:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbacda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.238328:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbacd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e3f expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.238350:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbacda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e3f expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.238360:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:3.0:1788863716.238363:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863716.238366:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554400, rc 0) 00000100:00100000:3.0:1788863716.238453:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+12:9685:x1875759298792320:12345-192.168.204.51@tcp:101:rm.0 Request processed in 832us (3451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863716.238461:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:3.0:1788863716.249321:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863716.249623:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298792576 00000100:00100000:0.0:1788863716.249643:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298792576 00000100:00100000:0.0:1788863716.249740:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:0.0:1788863716.249753:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+12:9685:x1875759298792576:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:0.0:1788863716.249787:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863716.249819:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbace1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e46 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863716.252100:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788863716.252367:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbace1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e46 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.252391:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330800) 00010000:00010000:0.0:1788863716.252394:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863716.252399:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbace1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e46 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.252418:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031400, rc 0) 00000100:00100000:0.0:1788863716.252539:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:9685:x1875759298792576:12345-192.168.204.51@tcp:101:rm.0 Request processed in 2787us (4612us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788863716.252552:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:2.0:1788863716.266753:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863716.266920:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298792704 00000100:00100000:1.0:1788863716.266949:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298792704 00000100:00100000:1.0:1788863716.267021:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:1.0:1788863716.267033:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:9685:x1875759298792704:12345-192.168.204.51@tcp:37:rm.0 00000100:00100000:1.0:1788863716.279003:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:9685:x1875759298792704:12345-192.168.204.51@tcp:37:rm.0 Request processed in 11956us (12253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863716.279020:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:3.0:1788863716.289222:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863716.289584:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298792960 00000100:00100000:0.0:1788863716.289603:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298792960 00000100:00100000:0.0:1788863716.289675:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1788863716.289685:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc2ed1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:9685:x1875759298792960:12345-192.168.204.51@tcp:35:rm.0 00000100:00100000:0.0:1788863716.290094:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc2ed1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:9685:x1875759298792960:12345-192.168.204.51@tcp:35:rm.0 Request processed in 408us (887us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788863716.290103:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:2.0:1788863716.296547:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863716.296799:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298793216 00000100:00100000:3.0:1788863716.296816:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298793216 00000100:00100000:3.0:1788863716.296954:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1788863716.296967:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:9685:x1875759298793216:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:3.0:1788863716.297008:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863716.297057:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbacef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e4d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.297464:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbacf6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.297486:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbacf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.297502:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbacf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863716.297515:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788863716.297806:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbacef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e4d expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.297836:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbacf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e4d expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.297848:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:2.0:1788863716.297923:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788863716.297929:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555600, rc 0) 00000100:00100000:2.0:1788863716.298023:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:9685:x1875759298793216:12345-192.168.204.51@tcp:101:rm.0 Request processed in 1056us (1494us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788863716.298043:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1788863716.301371:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863716.302770:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298793344 00000100:00100000:0.0:1788863716.302804:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298793344 00000100:00100000:0.0:1788863716.302935:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:0.0:1788863716.302950:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:9685:x1875759298793344:12345-192.168.204.51@tcp:41:rm.0 00000004:00000024:0.0:1788863716.303052:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788863716.303184:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:9685:x1875759298793344:12345-192.168.204.51@tcp:41:rm.0 Request processed in 237us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863716.303195:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00010000:00010000:1.0:1788863716.311063:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863716.321155:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863716.321953:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298793472 00000100:00100000:0.0:1788863716.321972:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298793472 00000100:00100000:0.0:1788863716.322064:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:0.0:1788863716.322079:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:9685:x1875759298793472:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:0.0:1788863716.322112:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863716.322140:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbad04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.322225:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.322244:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.322258:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.322277:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.322284:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.322290:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324001:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbad19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324058:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbad19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324072:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbad19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863716.324124:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788863716.324130:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788863716.324159:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbad19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324174:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbad19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324185:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324192:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324201:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324209:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863716.324215:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324224:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324240:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:0.0:1788863716.324244:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863716.324262:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324270:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324290:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324297:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324305:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324310:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863716.324313:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324319:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324327:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3e0961b7 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863716.324330:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863716.324333:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.324339:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.327359:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbad04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e54 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.327449:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbad19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e54 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.327461:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:0.0:1788863716.327465:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863716.327468:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031e00, rc 0) 00000100:00100000:1.0:1788863716.327670:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+17:9685:x1875759298793472:12345-192.168.204.51@tcp:101:rm.0 Request processed in 5590us (6525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863716.327683:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:2.0:1788863716.339092:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863716.339226:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298793728 00000100:00100000:0.0:1788863716.339240:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298793728 00000100:00100000:0.0:1788863716.339322:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:0.0:1788863716.339335:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+17:9685:x1875759298793728:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:0.0:1788863716.339427:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788863716.339469:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbad19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e54 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.339500:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbacc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e38 expref: 16 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.339516:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:0.0:1788863716.339537:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbacda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e3f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.339546:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:0.0:1788863716.340023:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863716.340074:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbad20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.340123:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbad20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.340137:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbad20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.340159:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.340167:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.340174:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.340335:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.340343:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.340351:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788863716.342257:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788863716.342280:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345471427076ns, next at 346471423161ns, rc = 0 00010000:00010000:3.0:1788863716.342402:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbad35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.342420:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbad35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.342433:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbad35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.342441:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbad35 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.342447:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbad35 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.342454:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbad35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.342479:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863716.342505:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.342510:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad2e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.342516:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.342522:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863716.342528:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.342535:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad2e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.342564:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:3.0:1788863716.342568:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788863716.342574:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad2e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.342584:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbad2e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.342887:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863716.342896:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbad35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.342905:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863716.342920:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbad35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.342928:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbad35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.342940:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:2.0:1788863716.342943:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788863716.342946:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbad35 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.342951:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbad35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.342969:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863716.342971:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863716.342973:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863716.343134:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbad20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.343142:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbad20 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.343149:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbad20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.343154:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863716.343157:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbad20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.343163:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbad20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.343172:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:3.0:1788863716.343175:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863716.343177:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbad20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863716.343182:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbad20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863716.343206:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecb4f0af reply state 0000000020b1a44a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863716.343216:0:5841:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863716.343404:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:9685:x1875759298793728:12345-192.168.204.51@tcp:36:rm.0 Request processed in 4063us (4320us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788863716.343415:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00010000:00010000:0.0:1788863716.346899:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.346926:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.346935:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.346967:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863716.346973:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.346982:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.347005:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3e0961b7 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863716.347009:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863716.347014:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.347021:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbad27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863716.352174:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863716.352425:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298793984 00000100:00100000:1.0:1788863716.352441:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298793984 00000100:00100000:1.0:1788863716.352519:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1788863716.352532:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:9685:x1875759298793984:12345-192.168.204.51@tcp:35:rm.0 00000100:00100000:1.0:1788863716.352964:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:9685:x1875759298793984:12345-192.168.204.51@tcp:35:rm.0 Request processed in 432us (805us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788863716.352973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1788863716.356335:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863716.356454:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298794240 00000100:00100000:0.0:1788863716.356467:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298794240 00000100:00100000:0.0:1788863716.356548:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1788863716.356566:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:9685:x1875759298794240:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:0.0:1788863716.356650:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788863716.356688:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbacf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e4d expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.356715:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbac94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e2a expref: 15 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.356727:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:0.0:1788863716.356751:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbac55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e1c expref: 14 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.356779:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330800) 00010000:00010000:0.0:1788863716.356787:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863716.356822:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166b600/0x744cd7666bbbad3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.356837:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166b600/0x744cd7666bbbad3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.356901:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166b600/0x744cd7666bbbad3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.356918:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166ac00/0x744cd7666bbbad43 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.356926:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166ac00/0x744cd7666bbbad43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.356933:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166ac00/0x744cd7666bbbad43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.357293:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a800/0x744cd7666bbbad4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.357303:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a800/0x744cd7666bbbad4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.357311:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a800/0x744cd7666bbbad4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863716.358021:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788863716.358051:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a800/0x744cd7666bbbad4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358068:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a800/0x744cd7666bbbad4a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358075:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a800/0x744cd7666bbbad4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358082:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166a800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863716.358088:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a800/0x744cd7666bbbad4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358096:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a800/0x744cd7666bbbad4a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358107:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8bcb0f5f00) 00010000:00010000:0.0:1788863716.358110:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788863716.358115:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a800/0x744cd7666bbbad4a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358121:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a800/0x744cd7666bbbad4a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358144:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166b600/0x744cd7666bbbad3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358150:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166b600/0x744cd7666bbbad3c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358156:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166b600/0x744cd7666bbbad3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358161:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166b600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863716.358169:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166b600/0x744cd7666bbbad3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358175:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166b600/0x744cd7666bbbad3c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358182:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863716.358184:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863716.358187:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166b600/0x744cd7666bbbad3c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863716.358193:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166b600/0x744cd7666bbbad3c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863716.358205:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd71fb9e reply state 000000008ee42d04 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166ac00/0x744cd7666bbbad43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863716.358214:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863716.358320:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:9685:x1875759298794240:12345-192.168.204.51@tcp:36:rm.0 Request processed in 1758us (1996us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788863716.358329:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00010000:00010000:2.0:1788863716.370003:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166ac00/0x744cd7666bbbad43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.370028:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166ac00/0x744cd7666bbbad43 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.370068:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166ac00/0x744cd7666bbbad43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.370076:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166ac00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863716.370083:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166ac00/0x744cd7666bbbad43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.370091:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166ac00/0x744cd7666bbbad43 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.370138:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863716.370141:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863716.370147:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166ac00/0x744cd7666bbbad43 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863716.370153:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166ac00/0x744cd7666bbbad43 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863716.440174:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8ac19a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323992576:0@lo:400:kworker.0 00000100:00100000:3.0:1788863716.440289:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863716.440365:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8ac19a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323993088:0@lo:400:kworker.0 00000100:00100000:3.0:1788863716.440397:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863716.440591:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863716.440618:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8ac19a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323992704:0@lo:400:kworker.0 00000100:00100000:3.0:1788863716.440698:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863716.440785:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323992576 00000100:00100000:3.0:1788863716.440793:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323992576 00000100:00100000:3.0:1788863716.440842:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323992704 00000100:00100000:3.0:1788863716.440846:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323992704 00000100:00100000:3.0:1788863716.440913:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788863716.440922:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323992576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863716.441100:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323992576:12345-0@lo:400:kworker.0 Request processed in 178us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863716.441108:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788863716.441127:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788863716.441134:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323992704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863716.441328:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8ac19a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323992448:0@lo:400:kworker.0 00000100:00100000:3.0:1788863716.441383:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323992704:12345-0@lo:400:kworker.0 Request processed in 247us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863716.441391:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788863716.441408:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788863716.441423:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863716.441451:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323992448 00000100:00100000:3.0:1788863716.441457:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323992448 00000100:00100000:2.0:1788863716.441465:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8ac19a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759323992960:0@lo:400:kworker.0 00000100:00100000:3.0:1788863716.441499:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788863716.441508:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863716.441517:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759323992448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863716.441546:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863716.441565:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8ac19a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323992832:0@lo:400:kworker.0 00000100:00100000:3.0:1788863716.441573:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759323992448:12345-0@lo:400:kworker.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863716.441583:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788863716.441612:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863716.441637:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323993088 00000100:00100000:3.0:1788863716.441643:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323993088 00000100:00100000:3.0:1788863716.441686:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323992832 00000100:00100000:3.0:1788863716.441691:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323992832 00000100:00100000:2.0:1788863716.441698:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8ac19a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759323992448:0@lo:400:kworker.0 00000100:00100000:3.0:1788863716.441718:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788863716.441732:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323993088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863716.441784:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323993088:12345-0@lo:400:kworker.0 Request processed in 59us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863716.441795:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788863716.441829:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788863716.441842:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323992832:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788863716.442129:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863716.442136:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863716.442207:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323992960 00000100:00100000:1.0:1788863716.442214:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323992960 00000100:00100000:1.0:1788863716.442272:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788863716.442282:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759323992960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863716.443212:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8ac19a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323992704:0@lo:400:kworker.0 00000100:00100000:3.0:1788863716.450708:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323992832:12345-0@lo:400:kworker.0 Request processed in 8851us (9076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863716.450731:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788863716.450916:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323993216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863716.451227:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863716.452130:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759323992960:12345-0@lo:400:kworker.0 Request processed in 9837us (10612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863716.452170:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788863716.452343:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323993216 00000100:00100000:1.0:1788863716.452357:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323993216 00000100:00100000:1.0:1788863716.452492:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788863716.452501:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323993216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863716.452536:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863716.452981:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759323993216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 479us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863716.452990:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788863716.453015:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788863716.453329:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bca963480 x1875759323993216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863716.453360:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759323993216:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788863716.453622:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8ac19a2680 x1875759323992832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863716.453634:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8ac19a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323992832:0@lo:400:kworker.0 00000100:00100000:0.0:1788863716.453817:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8ac19a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323992576:0@lo:400:kworker.0 00000100:00100000:2.0:1788863716.453995:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8ac19a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759323992960:0@lo:400:kworker.0 00010000:00080000:0.0:1788863716.454009:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8ac19a2a00 x1875759323993088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863716.454023:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8ac19a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323993088:0@lo:400:kworker.0 00010000:00010000:2.0:1788863717.336002:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863718.214420:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863718.214475:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863718.214512:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863718.214552:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863718.214603:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298794368 00000100:00100000:2.0:1788863718.214616:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298794368 00000100:00100000:2.0:1788863718.214681:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 249 00000100:00100000:2.0:1788863718.214692:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298794368:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863718.214787:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298794368:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 96us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863718.214796:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 249 00000100:00100000:0.0:1788863718.219528:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298794624 00000100:00100000:0.0:1788863718.219563:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298794624 00000100:00100000:0.0:1788863718.219674:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:0.0:1788863718.219689:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298794624:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863718.220321:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298794496 00000100:00100000:3.0:1788863718.220330:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298794496 00000100:00100000:3.0:1788863718.220399:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298794752 00000100:00100000:3.0:1788863718.220403:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298794752 00000100:00100000:3.0:1788863718.220431:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 105 00000100:00100000:3.0:1788863718.220439:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:2351:x1875759298794496:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863718.220525:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:2351:x1875759298794496:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 86us (6129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863718.220532:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 105 00000100:00100000:3.0:1788863718.220550:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:3.0:1788863718.220556:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298794752:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863718.220581:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298794752:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (6106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863718.220587:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00080000:2.0:1788863718.221033:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863718.221041:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863718.222711:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298794624:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 3011us (8143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863718.222726:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00010000:00010000:1.0:1788863718.361840:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863718.487318:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323993344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863718.487414:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863718.487546:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323993344 00000100:00100000:1.0:1788863718.487559:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323993344 00000100:00100000:1.0:1788863718.487647:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788863718.487659:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323993344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863718.487708:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863718.487758:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323993344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863718.487764:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788863718.487898:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff177480 x1875759323993344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863718.487917:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323993344:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788863718.489687:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788863719.392676:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863720.414300:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788863721.122360:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788863721.122386:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788863721.122615:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323993472:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788863721.122721:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863721.122821:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323993472 00000100:00100000:1.0:1788863721.122832:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323993472 00000100:00100000:1.0:1788863721.122931:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788863721.122954:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323993472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788863721.123462:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788863721.123506:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9fe4e3, atime: 0x6a9fe4e3, ctime: 0x6a9fe4e3, blocks: 0x1 00010000:00010000:1.0:1788863721.123515:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1dab53a/0x744cd7666bbbad51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.123536:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1788863721.123540:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863721.123547:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1dab53a/0x744cd7666bbbad51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.123566:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1dab53a/0x744cd7666bbbad51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.123576:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1dab53a/0x744cd7666bbbad51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.123585:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1dab53a/0x744cd7666bbbad51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863721.123612:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788863721.124367:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875759323993472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1424us (1644us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788863721.124378:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788863721.124412:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788863721.124455:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8bff177100/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788863721.124461:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323993472:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788863721.125044:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863721.125056:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1dab53a/0x744cd7666bbbad51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.125067:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b600 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863721.125072:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1dab53a/0x744cd7666bbbad51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.125082:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1dab53a/0x744cd7666bbbad51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.125105:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1dab53a/0x744cd7666bbbad51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.125111:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1dab53a/0x744cd7666bbbad51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863721.125136:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863721.125138:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863721.125140:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863721.430408:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788863721.540133:0:11618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788863721.564689:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323993600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863721.564777:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863721.564998:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323993856:0@lo:400:kworker.0 00000100:00100000:1.0:1788863721.565031:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863721.565097:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863721.565104:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323993984:0@lo:400:kworker.0 00000100:00100000:1.0:1788863721.565128:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863721.565183:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323993856 00000100:00100000:1.0:1788863721.565192:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323993856 00000100:00100000:1.0:1788863721.565235:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323993984 00000100:00100000:1.0:1788863721.565238:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323993984 00000100:00100000:1.0:1788863721.565270:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788863721.565293:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323993856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863721.565353:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323993856:12345-0@lo:400:kworker.0 Request processed in 74us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863721.565361:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788863721.565383:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788863721.565388:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323993984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863721.565422:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759323993984:12345-0@lo:400:kworker.0 Request processed in 34us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863721.565427:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788863721.565445:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863721.565677:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323994112:0@lo:400:kworker.0 00000100:00100000:0.0:1788863721.565705:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863721.565723:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788863721.565730:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323993728:0@lo:400:kworker.0 00000100:00100000:0.0:1788863721.565756:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863721.565780:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759323994240:0@lo:400:kworker.0 00000100:00100000:0.0:1788863721.565803:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863721.565832:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323994112 00000100:00100000:0.0:1788863721.565837:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323994112 00000100:00100000:0.0:1788863721.565891:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788863721.565899:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323994112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863721.565952:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323994112:12345-0@lo:400:kworker.0 Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863721.565960:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788863721.565996:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bcabdd180 x1875759323994112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863721.566010:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323994112:0@lo:400:kworker.0 00000100:00080000:0.0:1788863721.566032:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863721.566063:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323994240 00000100:00100000:0.0:1788863721.566066:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323994240 00000100:00100000:0.0:1788863721.566094:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788863721.566101:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759323994240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863721.566137:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759323994240:12345-0@lo:400:kworker.0 Request processed in 36us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863721.566157:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788863721.566190:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759323994240:0@lo:400:kworker.0 00000100:00080000:0.0:1788863721.566206:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863721.566228:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323993728 00000100:00100000:0.0:1788863721.566232:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323993728 00000100:00100000:0.0:1788863721.566261:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788863721.566269:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323993728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863721.566306:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323993728:12345-0@lo:400:kworker.0 Request processed in 38us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863721.566312:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788863721.566344:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323993728:0@lo:400:kworker.0 00000100:00100000:1.0:1788863721.569411:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759323993984:0@lo:400:kworker.0 00000100:00100000:1.0:1788863721.569454:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323993856:0@lo:400:kworker.0 00000100:00100000:3.0:1788863721.570589:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323993600 00000100:00100000:3.0:1788863721.570600:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323993600 00000100:00100000:3.0:1788863721.570675:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788863721.570686:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875759323993600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863721.570738:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863721.570839:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875759323993600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (6061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863721.570847:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788863721.570998:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323993600:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788863721.651075:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1788863722.454104:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788863722.913728:0:11666:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcbf70450 20000000:00000080:1.0:1788863722.913750:0:11666:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8bf4e74800 uarg=0000000000000000 20000000:01000000:1.0:1788863722.913797:0:11666:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788863722.913803:0:11666:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788863722.913818:0:11666:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788863722.917756:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788863722.918148:0:11666:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788863722.925727:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788863722.925786:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788863722.925840:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788863722.926280:0:11666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788863722.926302:0:11666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.926321:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbbabfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbabf3 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.926329:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbac08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbac01 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.926336:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bc0030e00/0x744cd7666bbbac16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbac0f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.926345:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbac1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e07 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.926363:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bf4e7a200/0x744cd7666bbbac24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e0e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.926372:0:11666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.926422:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bf4e7a200/0x744cd7666bbbac24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e0e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.926442:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bf4e7a200/0x744cd7666bbbac24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e0e expref: 12 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.926459:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875759323994368:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788863722.926587:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbac1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e07 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.926595:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbac1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e07 expref: 12 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.926621:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875759323994496:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788863722.926654:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc0030e00/0x744cd7666bbbac16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbac0f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.926661:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc0030e00/0x744cd7666bbbac16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbac0f expref: 18 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.926669:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875759323994624:0@lo:104: 00000100:00100000:3.0:1788863722.926704:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863722.926754:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbac08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbac01 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.926762:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbac08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbac01 expref: 18 pid: 5833 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.926770:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875759323994752:0@lo:104: 00000100:00100000:3.0:1788863722.926791:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863722.926822:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323994624 00000100:00100000:3.0:1788863722.926829:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323994624 00000100:00100000:3.0:1788863722.926900:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323994752 00000100:00100000:3.0:1788863722.926927:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323994752 00000100:00100000:3.0:1788863722.926947:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788863722.926955:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+4:11666:x1875759323994624:12345-0@lo:104: 00010000:00010000:3.0:1788863722.926967:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbac16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.927013:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788863722.927019:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+4:11666:x1875759323994624:12345-0@lo:104: Request processed in 65us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863722.927026:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788863722.927043:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788863722.927048:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:11666:x1875759323994752:12345-0@lo:104: 00010000:00010000:3.0:1788863722.927054:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbac08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.927083:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788863722.927088:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:11666:x1875759323994752:12345-0@lo:104: Request processed in 41us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863722.927102:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788863722.927133:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbbabfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbabf3 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.927141:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbbabfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbabf3 expref: 18 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863722.927149:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe08a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875759323994880:0@lo:104: 00000100:00100000:3.0:1788863722.927170:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863722.927192:0:5823:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788863722.927215:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323994880 00000100:00100000:3.0:1788863722.927218:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323994880 00000100:00100000:3.0:1788863722.927231:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788863722.927235:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe7b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:11666:x1875759323994880:12345-0@lo:104: 00010000:00010000:3.0:1788863722.927242:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbabfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863722.927267:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788863722.927271:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe7b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eff03fbe-e653-4192-b926-0416f2048378+3:11666:x1875759323994880:12345-0@lo:104: Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863722.927276:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788863722.927311:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1788863722.927331:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875759323994624:0@lo:104: 00000100:00100000:3.0:1788863722.927338:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875759323994752:0@lo:104: 00000100:00100000:3.0:1788863722.927343:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe08a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875759323994880:0@lo:104: 00010000:00010000:1.0:1788863722.927893:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788863722.927902:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbac16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.927920:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554200 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:1.0:1788863722.927924:0:8442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbac16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.927933:0:8442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbac16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863722.927941:0:8442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbac16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863722.927948:0:8442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788863722.927984:0:8442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbac16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.927992:0:8442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863722.928011:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbac16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928017:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bee554200/0x744cd7666bbbac0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbac16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928031:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863722.928035:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbac08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928054:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b800 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:1.0:1788863722.928057:0:8442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbac08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928063:0:8442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbac08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863722.928075:0:8442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbac08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863722.928080:0:8442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788863722.928093:0:8442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbac08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928099:0:8442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863722.928104:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbac08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928111:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbac01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbac08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928119:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863722.928121:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbabfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928127:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16e00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:1.0:1788863722.928129:0:8442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbabfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928144:0:8442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbabfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863722.928149:0:8442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbabfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863722.928154:0:8442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788863722.928166:0:8442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbabfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928171:0:8442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863722.928189:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbabfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928196:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16e00/0x744cd7666bbbabf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbabfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928210:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863722.928212:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863722.928213:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863722.928226:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323995008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863722.928273:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863722.928302:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863722.928307:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323995136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863722.928326:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863722.928357:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323995008 00000100:00100000:1.0:1788863722.928363:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323995008 00010000:00010000:1.0:1788863722.928389:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc0030e00/0x744cd7666bbbac16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbac0f expref: 19 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863722.928425:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323995136 00000100:00100000:1.0:1788863722.928429:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323995136 00010000:00010000:1.0:1788863722.928441:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbac08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbac01 expref: 20 pid: 5833 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863722.928459:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863722.928466:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+20:3306:x1875759323995008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863722.928478:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863722.928483:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc0030e00/0x744cd7666bbbac16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbac0f expref: 20 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928493:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc0030e00/0x744cd7666bbbac16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbac0f expref: 20 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928506:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0030e00/0x744cd7666bbbac16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbac0f expref: 20 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928517:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863722.928546:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323995008:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863722.928552:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788863722.928566:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863722.928572:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+18:3306:x1875759323995136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863722.928579:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863722.928584:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbac08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbac01 expref: 18 pid: 5833 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928592:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbac08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbac01 expref: 18 pid: 5833 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928686:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0030000/0x744cd7666bbbac08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbac01 expref: 18 pid: 5833 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.928696:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863722.928720:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+17:3306:x1875759323995136:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863722.928726:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863722.928762:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323995136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863722.928771:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323995008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788863722.929634:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863722.929666:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863722.929710:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323995264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863722.929751:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863722.930462:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323995264 00000100:00100000:1.0:1788863722.930473:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323995264 00010000:00010000:1.0:1788863722.930515:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbbabfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbabf3 expref: 17 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863722.930546:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788863722.930555:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2885c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+17:3308:x1875759323995264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863722.930570:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863722.930575:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbbabfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbabf3 expref: 17 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.930585:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbbabfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbabf3 expref: 17 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.930602:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0030200/0x744cd7666bbbabfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbabf3 expref: 17 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.930626:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863722.930692:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2885c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+16:3308:x1875759323995264:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863722.930699:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788863722.931527:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323995264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863722.933447:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875759323994368:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863722.934217:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875759323994496:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863722.934263:0:11666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863722.945829:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863722.945916:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863722.946017:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298794880 00000100:00100000:1.0:1788863722.946028:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298794880 00010000:00010000:1.0:1788863722.946071:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bf4e7a200/0x744cd7666bbbac24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e0e expref: 13 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863722.946113:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298795008 00000100:00100000:1.0:1788863722.946117:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298795008 00010000:00010000:1.0:1788863722.946129:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbac1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e07 expref: 14 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863722.946148:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:1.0:1788863722.946157:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+14:2350:x1875759298794880:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863722.946173:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863722.946179:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bf4e7a200/0x744cd7666bbbac24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e0e expref: 14 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946191:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bf4e7a200/0x744cd7666bbbac24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e0e expref: 14 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946221:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7a200/0x744cd7666bbbac24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e0e expref: 14 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946270:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863722.946332:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298794880:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 176us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863722.946341:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:1.0:1788863722.946357:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:1.0:1788863722.946364:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:2350:x1875759298795008:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863722.946374:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863722.946379:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbac1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e07 expref: 12 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946387:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbac1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e07 expref: 12 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946397:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbac1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e07 expref: 12 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946409:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946418:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946433:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946440:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946458:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946465:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946471:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17a00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863722.946475:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946484:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946501:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946518:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863722.946538:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:2350:x1875759298795008:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 175us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863722.946545:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00010000:00010000:1.0:1788863722.946570:0:11666:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946578:0:11666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863722.946585:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbad58 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863723.324346:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863723.325073:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298795136 00000100:00100000:0.0:1788863723.325089:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298795136 00000100:00100000:0.0:1788863723.325168:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 251 00000100:00100000:0.0:1788863723.325179:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:2350:x1875759298795136:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863723.325645:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:2350:x1875759298795136:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 464us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863723.325655:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 251 00000100:00100000:3.0:1788863723.336014:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863723.336223:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863723.336255:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863723.336310:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298795264 00000100:00100000:3.0:1788863723.336322:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298795264 00000100:00100000:3.0:1788863723.336401:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298795520 00000100:00100000:3.0:1788863723.336405:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298795520 00000100:00100000:3.0:1788863723.336433:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:3.0:1788863723.336445:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298795264:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863723.336542:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298795264:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 98us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863723.336550:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:3.0:1788863723.336571:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:3.0:1788863723.336578:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298795520:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863723.336608:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298795520:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863723.336614:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00080000:3.0:1788863723.336633:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863723.337301:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298795392 00000100:00100000:1.0:1788863723.337428:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298795392 00000100:00100000:1.0:1788863723.337514:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:1.0:1788863723.337524:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298795392:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863723.337589:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298795392:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 67us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863723.337597:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00080000:3.0:1788863723.337876:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788863723.478914:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863723.606796:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863723.618331:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323995392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863723.618486:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863723.619395:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323995392 00000100:00100000:2.0:1788863723.619411:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323995392 00000100:00100000:2.0:1788863723.619527:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788863723.619554:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323995392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863723.619617:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863723.619710:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323995392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863723.619718:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788863723.620059:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bcabdc700 x1875759323995392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863723.620130:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323995392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788863723.621149:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788863724.506084:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863724.541488:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863724.541835:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298795648 00000100:00100000:0.0:1788863724.541847:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298795648 00000100:00100000:0.0:1788863724.541972:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 252 00000100:00100000:0.0:1788863724.541982:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:5595:x1875759298795648:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863724.542006:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863724.542034:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc166a800/0x744cd7666bbbad5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e5b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.542071:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc166a800/0x744cd7666bbbad5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e5b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.542082:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc166a800/0x744cd7666bbbad5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e5b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.542096:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc166a800, rc 0) 00000100:00100000:0.0:1788863724.542163:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:5595:x1875759298795648:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 182us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.542170:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 252 00000100:00100000:2.0:1788863724.549037:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863724.550286:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298795776 00000100:00100000:0.0:1788863724.550305:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298795776 00000100:00100000:0.0:1788863724.550403:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 253 00000100:00100000:0.0:1788863724.550413:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:5595:x1875759298795776:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863724.551114:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:5595:x1875759298795776:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 698us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.551133:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 253 00000100:00100000:1.0:1788863724.559050:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863724.559146:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298795904 00000100:00100000:3.0:1788863724.559158:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298795904 00000100:00100000:3.0:1788863724.559241:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 254 00000100:00100000:3.0:1788863724.559255:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:5595:x1875759298795904:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.559601:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:5595:x1875759298795904:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 349us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863724.559611:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 254 00000100:00100000:3.0:1788863724.568675:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863724.568921:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298796032 00000100:00100000:0.0:1788863724.568932:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298796032 00000100:00100000:0.0:1788863724.568996:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 255 00000100:00100000:0.0:1788863724.569007:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd56f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:9957:x1875759298796032:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863724.569312:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd56f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:9957:x1875759298796032:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 305us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.569321:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 255 00000100:00100000:0.0:1788863724.573199:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863724.573289:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298796160 00000100:00100000:3.0:1788863724.573299:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298796160 00000100:00100000:3.0:1788863724.573356:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 256 00000100:00100000:3.0:1788863724.573367:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:9957:x1875759298796160:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788863724.573643:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:9957:x1875759298796160:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 276us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863724.573653:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 256 00000100:00100000:1.0:1788863724.582044:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863724.582178:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298796288 00000100:00100000:2.0:1788863724.582191:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298796288 00000100:00100000:2.0:1788863724.582256:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 257 00000100:00100000:2.0:1788863724.582276:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:5595:x1875759298796288:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863724.582295:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863724.582314:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbad66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e62 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863724.582378:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbad66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e62 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863724.582391:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbad66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e62 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863724.582401:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554000, rc 0) 00000100:00100000:2.0:1788863724.582482:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:5595:x1875759298796288:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 208us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863724.582490:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 257 00000100:00100000:1.0:1788863724.592407:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863724.592579:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298796416 00000100:00100000:0.0:1788863724.592591:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298796416 00000100:00100000:0.0:1788863724.592654:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 258 00000100:00100000:0.0:1788863724.592664:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:5595:x1875759298796416:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863724.593128:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:5595:x1875759298796416:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 463us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.593138:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 258 00000100:00100000:0.0:1788863724.601916:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863724.609510:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298796544 00000100:00100000:3.0:1788863724.609533:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298796544 00000100:00100000:2.0:1788863724.610021:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 259 00000100:00100000:2.0:1788863724.610032:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:5595:x1875759298796544:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863724.610420:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:5595:x1875759298796544:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 388us (8572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863724.610429:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 259 00000100:00100000:1.0:1788863724.619474:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863724.619759:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298796672 00000100:00100000:2.0:1788863724.619778:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298796672 00000100:00100000:0.0:1788863724.619931:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 260 00000100:00100000:0.0:1788863724.619950:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:9960:x1875759298796672:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863724.620473:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:9960:x1875759298796672:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 527us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.620483:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 260 00000100:00100000:1.0:1788863724.623727:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863724.623914:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298796800 00000100:00100000:0.0:1788863724.623929:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298796800 00000100:00100000:0.0:1788863724.624021:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 261 00000100:00100000:0.0:1788863724.624033:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:9960:x1875759298796800:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863724.624667:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:9960:x1875759298796800:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 628us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.624680:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 261 10000000:01000000:3.0:1788863724.631400:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788863724.631411:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bd2b49800 from 7 10000000:01000000:3.0:1788863724.631418:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788863724.631499:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863724.631515:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863724.631531:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863724.631570:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323995520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.631697:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863724.631785:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863724.631999:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323995520 00000100:00100000:0.0:1788863724.632011:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323995520 00000100:00100000:0.0:1788863724.632079:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788863724.632091:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+16:5838:x1875759323995520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863724.632109:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863724.632128:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbbad74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbad6d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.632160:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbbad74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbad6d expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.632172:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbbad74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbad6d expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.632183:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc166b600, rc 0) 00000100:00100000:0.0:1788863724.632581:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323995520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 491us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.632590:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788863724.633470:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323995520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863724.633636:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863724.633656:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863724.633790:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323995648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.633930:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863724.633972:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863724.634110:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323995648 00000100:00100000:0.0:1788863724.634120:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323995648 00000100:00100000:0.0:1788863724.634178:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788863724.634190:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323995648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863724.634639:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323995648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 450us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.634648:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788863724.634997:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323995648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.635052:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323995776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.635103:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863724.635185:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863724.635449:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323995776 00000100:00100000:0.0:1788863724.635458:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323995776 00000100:00100000:0.0:1788863724.635614:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788863724.635625:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323995776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863724.635914:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323995776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.635923:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788863724.636020:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323995776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863724.637471:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8ac19a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:11680:1875759323995904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863724.637612:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863724.637664:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc243b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788863724.637738:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323995904 00000100:00100000:0.0:1788863724.637748:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323995904 00000100:00100000:0.0:1788863724.637832:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788863724.637845:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:11680:x1875759323995904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863724.638178:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:11680:x1875759323995904:12345-0@lo:502:llog_process_th.0 Request processed in 335us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.638191:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788863724.638212:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8ac19a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:11680:1875759323995904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788863724.638253:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863724.638266:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863724.638275:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788863724.638283:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8bd2b49800 00000020:00000080:2.0:1788863724.638286:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788863724.638400:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8ac19a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:11680:1875759323996032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788863724.638446:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863724.638476:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd2875540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863724.638580:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323996032 00000100:00100000:0.0:1788863724.638586:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323996032 00000100:00100000:0.0:1788863724.638621:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788863724.638628:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:11680:x1875759323996032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863724.638774:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+17:11680:x1875759323996032:12345-0@lo:502:llog_process_th.0 Request processed in 146us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.638781:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788863724.639479:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8ac19a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:11680:1875759323996032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788863724.639643:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863724.639653:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863724.639655:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788863724.639660:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788863724.643621:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788863724.643684:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863724.643702:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863724.643724:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863724.643741:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788863724.643746:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bde7ad800 from 7 10000000:01000000:3.0:1788863724.643750:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788863724.643844:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863724.644070:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863724.644087:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863724.644128:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323996160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.644436:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863724.644649:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863724.646777:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323996160 00000100:00100000:0.0:1788863724.646801:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323996160 00000100:00100000:0.0:1788863724.646990:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788863724.647002:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+17:5838:x1875759323996160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863724.647025:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863724.647051:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc166ac00/0x744cd7666bbbad82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbad7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.647103:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc166ac00/0x744cd7666bbbad82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbad7b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.647118:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc166ac00/0x744cd7666bbbad82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbad7b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.647128:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc166ac00, rc 0) 00000100:00100000:0.0:1788863724.647232:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323996160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (2797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.647240:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788863724.647401:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323996160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863724.647427:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863724.647438:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863724.647551:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323996288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863724.647595:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863724.648269:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc74ae900 going to sleep for 11 seconds 00000100:00100000:3.0:1788863724.648383:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323996288 00000100:00100000:3.0:1788863724.648393:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323996288 00000100:00100000:3.0:1788863724.648434:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788863724.648445:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323996288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.649165:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323996288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 717us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863724.649176:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788863724.649226:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323996288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.649301:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323996416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.649371:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863724.649392:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ed180 going to sleep for 11 seconds 00000100:00100000:3.0:1788863724.649416:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323996416 00000100:00100000:3.0:1788863724.649422:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323996416 00000100:00100000:3.0:1788863724.649449:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788863724.649457:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323996416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.649673:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323996416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863724.649680:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788863724.649711:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323996416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.650317:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:11683:1875759323996544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863724.650376:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863724.650405:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323996544 00000100:00100000:3.0:1788863724.650411:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323996544 00000100:00100000:3.0:1788863724.650437:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788863724.650445:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:11683:x1875759323996544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863724.650880:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+18:11683:x1875759323996544:12345-0@lo:502:llog_process_th.0 Request processed in 404us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863724.650890:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788863724.650931:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863724.650952:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:11683:1875759323996544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863724.651183:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863724.651198:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863724.651201:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788863724.651210:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8bde7ad800 00000020:00000080:3.0:1788863724.651212:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788863724.651328:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:11683:1875759323996672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863724.651382:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863724.651415:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863724.651651:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323996672 00000100:00100000:0.0:1788863724.651662:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323996672 00000100:00100000:0.0:1788863724.651721:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788863724.651733:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:11683:x1875759323996672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863724.652268:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:11683:x1875759323996672:12345-0@lo:502:llog_process_th.0 Request processed in 532us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.652279:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788863724.652758:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:11683:1875759323996672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863724.652798:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863724.652814:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863724.652817:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788863724.652824:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788863724.653458:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788863724.653499:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863724.653513:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863724.653597:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863724.653612:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788863724.653616:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bd56cb800 from 7 10000000:01000000:3.0:1788863724.653620:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788863724.653683:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863724.653692:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863724.653706:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863724.653740:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323996800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.653816:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863724.653907:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863724.655517:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323996800 00000100:00100000:0.0:1788863724.655610:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323996800 00000100:00100000:0.0:1788863724.655791:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788863724.655805:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+18:5838:x1875759323996800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863724.655827:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863724.655886:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bc166ae00/0x744cd7666bbbad90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbad89 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.655923:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bc166ae00/0x744cd7666bbbad90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbad89 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.655938:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bc166ae00/0x744cd7666bbbad90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbad89 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.655948:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc166ae00, rc 0) 00000100:00100000:0.0:1788863724.656124:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323996800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 253us (2239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863724.656133:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788863724.656400:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323996800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863724.656424:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863724.656450:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863724.656562:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323996928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.656607:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863724.656655:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863724.656672:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323996928 00000100:00100000:3.0:1788863724.656676:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323996928 00000100:00100000:3.0:1788863724.656702:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788863724.656709:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323996928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.657625:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323996928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 909us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863724.657643:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788863724.657696:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323996928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.657745:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323997056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.657790:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863724.657810:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863724.657824:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323997056 00000100:00100000:3.0:1788863724.657829:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323997056 00000100:00100000:3.0:1788863724.657882:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788863724.657891:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323997056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.658211:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:5838:x1875759323997056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 320us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863724.658218:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788863724.658266:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eff03fbe-e653-4192-b926-0416f2048378:5838:1875759323997056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863724.658534:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:11684:1875759323997184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863724.658573:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863724.658596:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323997184 00000100:00100000:3.0:1788863724.658601:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323997184 00000100:00100000:3.0:1788863724.658623:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788863724.658629:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:11684:x1875759323997184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863724.658783:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:11684:x1875759323997184:12345-0@lo:502:llog_process_th.0 Request processed in 153us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863724.658790:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788863724.658821:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863724.658834:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:11684:1875759323997184:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863724.658893:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863724.658906:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863724.658909:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788863724.658918:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8bd56cb800 00000020:00000080:3.0:1788863724.658920:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788863724.659502:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:11684:1875759323997312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863724.659611:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863724.659718:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323997312 00000100:00100000:3.0:1788863724.659726:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323997312 00000100:00100000:3.0:1788863724.659757:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788863724.659765:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:11684:x1875759323997312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863724.661352:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:11684:x1875759323997312:12345-0@lo:502:llog_process_th.0 Request processed in 1561us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863724.661368:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788863724.661449:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863724.661481:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eff03fbe-e653-4192-b926-0416f2048378:11684:1875759323997312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863724.666070:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863724.666091:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863724.666094:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788863724.666101:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788863724.666346:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788863724.666373:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863724.666389:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863724.666404:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788863724.696345:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788863725.526099:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863725.718591:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788863726.550130:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863726.679287:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323997440:0@lo:400:kworker.0 00000100:00100000:2.0:1788863726.679403:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863726.679469:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323997952:0@lo:400:kworker.0 00000100:00100000:2.0:1788863726.679498:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863726.679533:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788863726.679542:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323997568:0@lo:400:kworker.0 00000100:00100000:2.0:1788863726.679564:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863726.679577:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323998080:0@lo:400:kworker.0 00000100:00100000:2.0:1788863726.679597:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863726.679701:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323997952 00000100:00100000:2.0:1788863726.679711:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323997952 00000100:00100000:2.0:1788863726.679781:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323997568 00000100:00100000:2.0:1788863726.679784:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323997568 00000100:00100000:2.0:1788863726.679828:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788863726.679915:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788863726.679941:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323997568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863726.680048:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323997568:12345-0@lo:400:kworker.0 Request processed in 119us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863726.680057:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788863726.680074:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323997952:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788863726.680093:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863726.680211:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323997952:12345-0@lo:400:kworker.0 Request processed in 360us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863726.680389:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788863726.680485:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323997568:0@lo:400:kworker.0 00000100:00100000:3.0:1788863726.680503:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323997952:0@lo:400:kworker.0 00000100:00100000:2.0:1788863726.680564:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323998080 00000100:00100000:2.0:1788863726.680572:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323998080 00000100:00080000:3.0:1788863726.680605:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863726.680633:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788863726.680644:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323998080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863726.680699:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323998080:12345-0@lo:400:kworker.0 Request processed in 58us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863726.680706:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788863726.681489:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323997696:0@lo:400:kworker.0 00000100:00100000:3.0:1788863726.681538:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788863726.681548:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8bff177100, transno 4294967300 00000100:00100000:0.0:1788863726.681556:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863726.681581:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323998080:0@lo:400:kworker.0 00000100:00100000:0.0:1788863726.681597:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323998208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863726.681633:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863726.681652:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323997440 00000100:00100000:3.0:1788863726.681661:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323997440 00000100:00100000:0.0:1788863726.681680:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863726.681693:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323997824:0@lo:400:kworker.0 00000100:00100000:3.0:1788863726.681718:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788863726.681725:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863726.681733:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323997440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863726.681767:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323997696 00000100:00100000:0.0:1788863726.681774:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323997696 00000100:00100000:0.0:1788863726.681821:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788863726.681843:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323997696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863726.681936:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323997696:12345-0@lo:400:kworker.0 Request processed in 107us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863726.681943:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1788863726.681965:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863726.682108:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323997440:12345-0@lo:400:kworker.0 Request processed in 377us (2703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863726.682116:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788863726.682170:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323997440:0@lo:400:kworker.0 00000100:00100000:0.0:1788863726.682370:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323997824 00000100:00100000:0.0:1788863726.682378:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323997824 00000100:00100000:0.0:1788863726.682419:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788863726.682428:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323997824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863726.682471:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323997824:12345-0@lo:400:kworker.0 Request processed in 44us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863726.682477:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788863726.682498:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788863726.682532:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bcabdf480 x1875759323997824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863726.682548:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323997824:0@lo:400:kworker.0 00000100:00100000:0.0:1788863726.682562:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323997696:0@lo:400:kworker.0 00000100:00100000:2.0:1788863726.682915:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323998208 00000100:00100000:2.0:1788863726.682922:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323998208 00000100:00100000:2.0:1788863726.682967:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788863726.682976:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323998208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863726.683311:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863726.683381:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323998208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 406us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863726.683388:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788863726.683538:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323998208:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788863727.574415:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863728.462000:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863728.462139:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863728.462276:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298796928 00000100:00100000:1.0:1788863728.462297:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298796928 00000100:00100000:1.0:1788863728.462396:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 278 00000100:00100000:1.0:1788863728.462408:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298796928:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863728.462518:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298796928:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 111us (11669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863728.462544:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 278 00000100:00100000:3.0:1788863728.467023:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298797184 00000100:00100000:3.0:1788863728.467041:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298797184 00000100:00100000:3.0:1788863728.467163:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:3.0:1788863728.467245:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298797184:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:1.0:1788863728.467256:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863728.472260:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863728.472506:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298797184:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 5311us (10343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863728.472526:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1788863728.473180:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298797056 00000100:00100000:0.0:1788863728.473201:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298797056 00000100:00100000:1.0:1788863728.476343:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:1.0:1788863728.476373:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298797056:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:0.0:1788863728.476479:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863728.476542:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298797056:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 183us (4304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863728.476551:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:1.0:1788863728.476700:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863728.476967:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298797312 00000100:00100000:2.0:1788863728.476984:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298797312 00000100:00100000:2.0:1788863728.477060:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:2.0:1788863728.477071:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298797312:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863728.477145:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298797312:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 76us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863728.477153:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00080000:0.0:1788863728.477964:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788863728.599597:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863728.726558:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863728.726593:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323998336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863728.726706:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863728.727025:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323998336 00000100:00100000:2.0:1788863728.727036:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323998336 00000100:00100000:2.0:1788863728.727126:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788863728.727140:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323998336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863728.727218:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863728.727296:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323998336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863728.727305:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788863728.727354:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bcabdd880 x1875759323998336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863728.727377:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323998336:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788863728.727548:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788863729.622664:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863730.648468:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863731.670263:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863731.799128:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863731.799158:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323998464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863731.799234:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863731.799297:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323998464 00000100:00100000:2.0:1788863731.799315:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323998464 00000100:00100000:2.0:1788863731.799377:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788863731.799386:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323998464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863731.799418:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863731.799462:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759323998464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863731.799480:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788863731.799503:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863731.799541:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759323998464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863731.803135:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323998720:0@lo:400:kworker.0 00000100:00100000:2.0:1788863731.803211:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863731.803278:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863731.803285:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323998848:0@lo:400:kworker.0 00000100:00100000:2.0:1788863731.803320:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863731.803357:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323998720 00000100:00100000:2.0:1788863731.803365:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323998720 00000100:00100000:2.0:1788863731.803413:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323998848 00000100:00100000:2.0:1788863731.803416:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323998848 00000100:00100000:2.0:1788863731.803449:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788863731.803458:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323998720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863731.804236:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788863731.804249:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323998848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863731.804345:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759323998848:12345-0@lo:400:kworker.0 Request processed in 99us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863731.804355:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788863731.804405:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323998976:0@lo:400:kworker.0 00000100:00100000:3.0:1788863731.804438:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863731.804593:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788863731.804601:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323998592:0@lo:400:kworker.0 00000100:00100000:3.0:1788863731.804632:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863731.804653:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323999104:0@lo:400:kworker.0 00000100:00100000:3.0:1788863731.804671:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863731.804697:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323998592 00000100:00100000:3.0:1788863731.804703:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323998592 00000100:00100000:3.0:1788863731.804747:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788863731.805017:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759323998720:12345-0@lo:400:kworker.0 Request processed in 1559us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863731.805025:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788863731.805039:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323999104 00000100:00100000:2.0:1788863731.805043:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323999104 00000100:00100000:2.0:1788863731.805069:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788863731.805075:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323999104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863731.805106:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759323999104:12345-0@lo:400:kworker.0 Request processed in 32us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863731.805113:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1788863731.805134:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863731.805172:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759323999104:0@lo:400:kworker.0 00000100:00100000:2.0:1788863731.805206:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759323998848:0@lo:400:kworker.0 00000100:00100000:2.0:1788863731.805217:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759323998720:0@lo:400:kworker.0 00000100:00100000:3.0:1788863731.806090:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323998592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863731.806188:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759323998592:12345-0@lo:400:kworker.0 Request processed in 1423us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863731.806197:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788863731.806982:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323998976 00000100:00100000:0.0:1788863731.806994:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323998976 00000100:00100000:0.0:1788863731.807059:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788863731.807068:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323998976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863731.807123:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759323998976:12345-0@lo:400:kworker.0 Request processed in 56us (2684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863731.807130:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788863731.807419:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863731.807465:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759323998592:0@lo:400:kworker.0 00010000:00080000:3.0:1788863731.807989:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bf4c5ad80 x1875759323998976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863731.808003:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759323998976:0@lo:400:kworker.0 00010000:00010000:1.0:1788863732.701259:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863733.572624:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863733.572662:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863733.572690:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863733.572728:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863733.572753:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298797568 00000100:00100000:0.0:1788863733.572762:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298797568 00000100:00100000:0.0:1788863733.572811:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298797824 00000100:00100000:0.0:1788863733.572814:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298797824 00000100:00100000:0.0:1788863733.572835:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:0.0:1788863733.572843:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298797568:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863733.572955:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298797568:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 111us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863733.572963:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:0.0:1788863733.572992:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:0.0:1788863733.572998:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298797824:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863733.573038:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298797824:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 39us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863733.573044:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:0.0:1788863733.573062:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298797440 00000100:00100000:0.0:1788863733.573066:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298797440 00000100:00100000:0.0:1788863733.573090:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 280 00000100:00100000:0.0:1788863733.573096:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298797440:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863733.573119:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298797440:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863733.573126:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 280 00000100:00100000:0.0:1788863733.573266:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298797696 00000100:00100000:0.0:1788863733.573280:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298797696 00000100:00100000:0.0:1788863733.573311:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:0.0:1788863733.573318:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298797696:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863733.573346:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298797696:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 29us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863733.573352:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00080000:0.0:1788863733.573368:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863733.573372:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788863733.719910:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863733.848957:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323999232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863733.849039:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863733.849680:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323999232 00000100:00100000:1.0:1788863733.849700:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323999232 00000100:00100000:1.0:1788863733.849766:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788863733.849776:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323999232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863733.849813:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863733.849900:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323999232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863733.849906:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788863733.849963:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bcabdca80 x1875759323999232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863733.849992:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323999232:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788863733.850049:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788863734.743356:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863735.767114:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863735.959106:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788863736.794786:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863736.918569:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323999744:0@lo:400:kworker.0 00000100:00100000:2.0:1788863736.918833:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863736.918917:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788863736.918924:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323999360:0@lo:400:kworker.0 00000100:00100000:2.0:1788863736.918955:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863736.919047:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759323999872:0@lo:400:kworker.0 00000100:00100000:3.0:1788863736.919068:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323999488:0@lo:400:kworker.0 00000100:00100000:2.0:1788863736.919077:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863736.919114:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323999744 00000100:00100000:2.0:1788863736.919121:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323999744 00000100:00100000:2.0:1788863736.919178:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788863736.919179:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863736.919192:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323999744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863736.919209:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324000000:0@lo:400:kworker.0 00000100:00100000:0.0:1788863736.919226:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323999872 00000100:00100000:0.0:1788863736.919232:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323999872 00000100:00100000:0.0:1788863736.919271:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323999488 00000100:00100000:0.0:1788863736.919274:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323999488 00000100:00100000:0.0:1788863736.919291:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788863736.919298:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759323999872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863736.919427:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759323999616:0@lo:400:kworker.0 00000100:00100000:0.0:1788863736.929154:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759323999872:12345-0@lo:400:kworker.0 Request processed in 9847us (10068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863736.929170:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788863736.929207:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788863736.929221:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323999488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863736.929305:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759323999488:12345-0@lo:400:kworker.0 Request processed in 90us (10130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863736.929311:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1788863736.929478:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863736.929484:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863736.929499:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323999360 00000100:00100000:0.0:1788863736.929507:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323999360 00000100:00100000:0.0:1788863736.929601:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788863736.929608:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323999360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863736.929658:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759323999360:12345-0@lo:400:kworker.0 Request processed in 51us (10702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863736.929665:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788863736.930331:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863736.930350:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759323999360:0@lo:400:kworker.0 00000100:00100000:3.0:1788863736.930408:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759323999488:0@lo:400:kworker.0 00000100:00100000:0.0:1788863736.930419:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759323999872:0@lo:400:kworker.0 00000100:00100000:3.0:1788863736.930453:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324000000 00000100:00100000:3.0:1788863736.930459:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324000000 00000100:00100000:3.0:1788863736.930520:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788863736.930527:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324000000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863736.930579:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324000000:12345-0@lo:400:kworker.0 Request processed in 53us (2356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863736.930603:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788863736.930640:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863736.930686:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324000000:0@lo:400:kworker.0 00000100:00100000:1.0:1788863736.933265:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863736.933328:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324000128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863736.933373:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863736.938431:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759323999616 00000100:00100000:3.0:1788863736.938451:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759323999616 00000100:00100000:3.0:1788863736.938553:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788863736.938564:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759323999616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863736.938678:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759323999616:12345-0@lo:400:kworker.0 Request processed in 115us (5420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863736.938685:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788863736.938925:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324000128 00000100:00100000:0.0:1788863736.938930:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324000128 00000100:00100000:0.0:1788863736.938967:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788863736.938985:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324000128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788863736.939032:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863736.939070:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324000128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (5696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863736.939076:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788863736.949673:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863736.949737:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759323999616:0@lo:400:kworker.0 00000100:00100000:1.0:1788863736.949782:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324000128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863736.950718:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759323999744:12345-0@lo:400:kworker.0 Request processed in 31525us (31879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863736.950732:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788863736.955451:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bf4c5aa00 x1875759323999744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863736.955471:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759323999744:0@lo:400:kworker.0 00010000:00010000:0.0:1788863737.814044:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863738.689166:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863738.689223:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863738.689621:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298798080 00000100:00100000:2.0:1788863738.689631:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298798080 00000100:00100000:2.0:1788863738.689711:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:2.0:1788863738.689722:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2352:x1875759298798080:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863738.689801:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2352:x1875759298798080:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 81us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863738.689809:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00080000:1.0:1788863738.690374:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863738.690422:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298797952 00000100:00100000:0.0:1788863738.690428:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298797952 00000100:00100000:0.0:1788863738.690525:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 282 00000100:00100000:0.0:1788863738.690533:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2352:x1875759298797952:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863738.690576:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2352:x1875759298797952:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 45us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863738.690583:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 282 00000100:00100000:1.0:1788863738.731068:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863738.731162:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863738.731484:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298798336 00000100:00100000:2.0:1788863738.731497:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298798336 00000100:00100000:2.0:1788863738.731589:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:2.0:1788863738.731612:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2353:x1875759298798336:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863738.731707:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2353:x1875759298798336:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 99us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863738.731730:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:0.0:1788863738.732844:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298798208 00000100:00100000:0.0:1788863738.732879:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298798208 00000100:00100000:0.0:1788863738.732936:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:0.0:1788863738.732954:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2349:x1875759298798208:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:0.0:1788863738.732992:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbaccc 00000100:00080000:0.0:1788863738.733002:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8e8bf4f1e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788863738.733048:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788863738.733651:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+2:2349:x1875759298798208:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 696us (2596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863738.733660:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00080000:1.0:1788863738.733827:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863738.733833:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788863738.739374:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863738.840832:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863738.969204:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324000256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863738.969276:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863738.969572:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324000256 00000100:00100000:1.0:1788863738.969581:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324000256 00000100:00100000:1.0:1788863738.969663:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788863738.969673:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324000256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863738.969711:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863738.969760:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324000256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863738.969766:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788863738.969803:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bcabddf80 x1875759324000256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863738.969820:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324000256:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788863738.969970:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788863739.863148:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863740.886134:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863741.910671:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863742.041383:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759324000512:0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.041476:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863742.041634:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324000768:0@lo:400:kworker.0 00000100:00100000:0.0:1788863742.041684:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863742.041757:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324000768 00000100:00100000:0.0:1788863742.041770:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324000768 00000100:00100000:3.0:1788863742.041958:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324001024:0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.041996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863742.042045:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863742.042057:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324000640:0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.042085:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863742.042132:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324000512 00000100:00100000:3.0:1788863742.042137:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324000512 00000100:00100000:3.0:1788863742.042176:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324000640 00000100:00100000:3.0:1788863742.042178:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324000640 00000100:00100000:3.0:1788863742.042199:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788863742.042208:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759324000512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.042279:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759324000512:12345-0@lo:400:kworker.0 Request processed in 71us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.042307:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788863742.042327:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788863742.042334:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759324000640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.042364:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759324000640:12345-0@lo:400:kworker.0 Request processed in 31us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.042369:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788863742.042412:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324000640:0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.042424:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759324000512:0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.042470:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324001024 00000100:00100000:3.0:1788863742.042474:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324001024 00000100:00100000:3.0:1788863742.042502:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788863742.042508:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324000768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.042559:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324000768:12345-0@lo:400:kworker.0 Request processed in 49us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.042567:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788863742.042591:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788863742.042599:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324001152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863742.042602:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324001024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.042672:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324001024:12345-0@lo:400:kworker.0 Request processed in 74us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.042679:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788863742.042697:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788863742.042729:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bffe0b480 x1875759324000768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863742.042745:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324000768:0@lo:400:kworker.0 00000100:00100000:1.0:1788863742.042768:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324001152 00000100:00100000:3.0:1788863742.042771:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788863742.042778:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324001152 00000100:00100000:3.0:1788863742.042796:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759324000384:0@lo:400:kworker.0 00000100:00100000:1.0:1788863742.042834:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788863742.042840:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863742.042887:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324001152:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863742.042915:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759324000896:0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.042940:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788863742.042945:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863742.042973:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324000896 00000100:00100000:3.0:1788863742.042979:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324000896 00000100:00100000:3.0:1788863742.043018:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788863742.043024:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759324000896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.043065:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759324000896:12345-0@lo:400:kworker.0 Request processed in 42us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.043071:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788863742.043093:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759324000896:0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.043115:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324001024:0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.043143:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324000384 00000100:00100000:3.0:1788863742.043145:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324000384 00000100:00100000:3.0:1788863742.043167:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788863742.043172:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759324000384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863742.043200:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759324000384:12345-0@lo:400:kworker.0 Request processed in 28us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863742.043206:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788863742.043235:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759324000384:0@lo:400:kworker.0 00000100:00100000:1.0:1788863742.044311:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324001152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1459us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863742.044327:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788863742.044359:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324001152:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788863742.044903:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863742.044909:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863742.044912:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788863742.117765:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000020:00000080:3.0:1788863742.117778:0:7637:0:(genops.c:885:class_export_put()) final put ffff8e8bf4f1d000/6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000020:00000080:1.0:1788863742.118334:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bf4f1d000/6fd3bcef-c680-4c25-aae1-ecd03903ad0a for lustre-OST0001 00000020:00000080:1.0:1788863742.118386:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bf4f1e800 for lustre-OST0001 00010000:00010000:3.0:1788863742.936097:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863743.807923:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863743.807971:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863743.808005:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863743.808755:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298798592 00000100:00100000:3.0:1788863743.808768:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298798592 00000100:00080000:1.0:1788863743.808839:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863743.808893:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298798720 00000100:00100000:3.0:1788863743.808898:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298798720 00000100:00100000:1.0:1788863743.808914:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:1.0:1788863743.808929:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2352:x1875759298798592:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863743.808939:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:3.0:1788863743.808950:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2353:x1875759298798720:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863743.809087:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298798464 00000100:00100000:2.0:1788863743.809094:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298798464 00000100:00100000:1.0:1788863743.809105:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2352:x1875759298798592:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 179us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863743.809115:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:2.0:1788863743.809135:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 284 00000100:00100000:2.0:1788863743.809144:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2353:x1875759298798464:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863743.811773:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2353:x1875759298798720:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 2812us (3754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863743.811793:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00080000:3.0:1788863743.812016:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863743.812182:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2353:x1875759298798464:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 3035us (4269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863743.812194:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 284 00010000:00010000:2.0:1788863743.958055:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863744.086012:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863744.086036:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324001280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863744.086126:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863744.086454:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324001280 00000100:00100000:3.0:1788863744.086465:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324001280 00000100:00100000:3.0:1788863744.086555:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788863744.086568:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324001280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863744.086619:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863744.086678:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324001280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863744.086686:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1788863744.086730:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bcabdf100 x1875759324001280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863744.086751:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324001280:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788863744.086818:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788863744.983736:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863745.174505:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788863746.006836:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863747.032535:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863747.158111:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324001408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863747.158203:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863747.158373:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324001408 00000100:00100000:3.0:1788863747.158383:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324001408 00000100:00100000:3.0:1788863747.158466:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788863747.158497:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324001408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863747.158542:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863747.158613:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324001408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863747.158620:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788863747.158687:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324001408:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788863747.158768:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863747.162210:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759324001664:0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.162320:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863747.162382:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788863747.162388:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759324001536:0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.162440:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863747.162475:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324002048:0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.162504:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863747.162546:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324001664 00000100:00100000:2.0:1788863747.162557:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324001664 00000100:00100000:2.0:1788863747.162617:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324002048 00000100:00100000:2.0:1788863747.162621:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324002048 00000100:00100000:2.0:1788863747.162672:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788863747.162683:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759324001664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.162758:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759324001664:12345-0@lo:400:kworker.0 Request processed in 77us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863747.162766:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788863747.162787:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788863747.162795:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324002048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.162825:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324002048:12345-0@lo:400:kworker.0 Request processed in 32us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863747.162831:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788863747.162882:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324001536 00000100:00100000:2.0:1788863747.162887:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324001536 00000100:00100000:2.0:1788863747.162934:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788863747.162942:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759324001536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.162982:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759324001536:12345-0@lo:400:kworker.0 Request processed in 43us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863747.162990:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788863747.163042:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324001792:0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.163071:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863747.163099:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863747.163105:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324001920:0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.163135:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863747.163168:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324001792 00000100:00100000:2.0:1788863747.163172:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324001792 00000100:00100000:2.0:1788863747.163204:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788863747.163211:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324001792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.163262:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324001792:12345-0@lo:400:kworker.0 Request processed in 51us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863747.163269:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788863747.163291:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324001920 00000100:00100000:2.0:1788863747.163295:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324001920 00000100:00100000:2.0:1788863747.163327:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788863747.163335:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324001920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.163369:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324001920:12345-0@lo:400:kworker.0 Request processed in 35us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863747.163375:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788863747.163479:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863747.163487:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788863747.163521:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bffdcc000 x1875759324001920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863747.163537:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324001920:0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.163552:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324001792:0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.163596:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759324001536:0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.163607:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324002048:0@lo:400:kworker.0 00000100:00100000:2.0:1788863747.163619:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759324001664:0@lo:400:kworker.0 00000001:02000400:3.0:1788863747.916386:0:11845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 06:35:45 (1788863745) 00010000:00010000:1.0:1788863748.060246:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863748.927772:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863748.927975:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298798848 00000100:00100000:2.0:1788863748.927990:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298798848 00000100:00100000:2.0:1788863748.928066:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 286 00000100:00100000:2.0:1788863748.928077:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298798848:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863748.928161:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298798848:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 85us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863748.928183:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 286 00000100:00100000:3.0:1788863748.935534:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863748.935595:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863748.936197:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298798976 00000100:00100000:0.0:1788863748.936210:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298799104 00000100:00100000:2.0:1788863748.936220:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298798976 00000100:00100000:0.0:1788863748.936224:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298799104 00000100:00100000:2.0:1788863748.936316:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00080000:1.0:1788863748.936326:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863748.936329:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298798976:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863748.936621:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298798976:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 294us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863748.936630:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:0.0:1788863748.943102:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:0.0:1788863748.943146:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298799104:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863748.945559:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298799104:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 2426us (9949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863748.945575:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 136 00010000:00010000:0.0:1788863749.078160:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863749.206243:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863749.206275:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324002176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863749.206367:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863749.206529:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324002176 00000100:00100000:1.0:1788863749.206551:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324002176 00000100:00100000:1.0:1788863749.206647:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788863749.206674:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324002176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863749.206722:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863749.206780:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324002176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863749.206789:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788863749.206977:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788863749.207016:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bcabddc00 x1875759324002176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863749.207037:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324002176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863749.891229:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863749.891525:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298799232 00000100:00100000:2.0:1788863749.891541:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298799232 00000100:00100000:2.0:1788863749.891630:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:2.0:1788863749.891644:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:10229:x1875759298799232:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863749.891679:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863749.891713:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbad97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e69 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863749.891831:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbad9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863749.891926:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbad9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863749.891947:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbad9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863749.892001:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788863749.892005:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863749.892108:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbad9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863749.892139:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbad97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e69 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863749.892167:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbad9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e69 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863749.892183:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330900) 00010000:00010000:2.0:1788863749.892186:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863749.892192:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555400, rc 0) 00000100:00100000:2.0:1788863749.892551:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:10229:x1875759298799232:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 906us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863749.892561:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:1.0:1788863749.903665:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863749.904383:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298799360 00000100:00100000:3.0:1788863749.904401:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298799360 00000100:00100000:3.0:1788863749.905259:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1788863749.905283:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:10230:x1875759298799360:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863749.905315:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863749.905343:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbada5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e70 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.905474:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbadac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.905682:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbadac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.905702:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbadac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.905724:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbadb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.905732:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbadb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.905740:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbadb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906108:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbadba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906119:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbadba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906127:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbadba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863749.906173:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788863749.906179:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863749.906475:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbadba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906692:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbadac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906701:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbadac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906709:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbadac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906715:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863749.906722:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbadac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906733:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbadac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906752:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330900) 00010000:00010000:3.0:1788863749.906755:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863749.906762:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbadac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906768:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbadac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906787:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbadb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906793:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbadb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906800:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbadb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906813:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863749.906816:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbadb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906822:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbadb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906831:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e8bc3015200) 00010000:00010000:3.0:1788863749.906833:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863749.906836:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbadb3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.906842:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbadb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.907359:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbada5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e70 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.907391:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbadba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e70 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863749.907399:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8bc3015d00) 00010000:00010000:3.0:1788863749.907402:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863749.907405:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17800, rc 0) 00000100:00100000:3.0:1788863749.907583:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:10230:x1875759298799360:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2307us (3936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863749.907595:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:1.0:1788863749.920986:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863749.921197:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298799616 00000100:00100000:0.0:1788863749.921213:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298799616 00000100:00100000:0.0:1788863749.921303:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:0.0:1788863749.921317:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:10230:x1875759298799616:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863749.921349:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863749.921400:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbadc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.923684:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbadc8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.923718:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbadc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.923756:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbadc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.926991:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadcf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.927021:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.927039:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.927717:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030000/0x744cd7666bbbadd6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.927741:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030000/0x744cd7666bbbadd6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.927750:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030000/0x744cd7666bbbadd6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863749.927763:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788863749.927994:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbadc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928004:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbadc8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928011:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbadc8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928016:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166a400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863749.928030:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbadc8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928038:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbadc8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928051:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8bc3015d00) 00010000:00010000:0.0:1788863749.928054:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863749.928060:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbadc8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928067:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbadc8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928081:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928087:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadcf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928093:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928098:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0030200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863749.928101:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928106:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadcf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928113:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863749.928115:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863749.928123:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadcf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.928129:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadcf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.929144:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbadc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e77 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.929170:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030000/0x744cd7666bbbadd6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e77 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863749.929179:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bcb0f5900) 00010000:00010000:0.0:1788863749.929181:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863749.929184:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030000, rc 0) 00000100:00100000:0.0:1788863749.929270:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:10230:x1875759298799616:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 7955us (8299us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788863749.929280:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:1.0:1788863749.939047:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863749.939452:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298799744 00000100:00100000:3.0:1788863749.939480:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298799744 00000100:00100000:3.0:1788863749.939560:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:3.0:1788863749.939572:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:10230:x1875759298799744:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788863749.939956:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:10230:x1875759298799744:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 384us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863749.939965:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00010000:00010000:1.0:1788863750.102878:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863750.294581:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788863751.126981:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788863751.885619:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1788863752.150472:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863752.279877:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324002560:0@lo:400:kworker.0 00000100:00100000:1.0:1788863752.279978:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863752.280146:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759324002304:0@lo:400:kworker.0 00000100:00100000:2.0:1788863752.280188:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863752.280227:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324002304 00000100:00100000:2.0:1788863752.280237:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324002304 00000100:00100000:2.0:1788863752.280299:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788863752.280310:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759324002304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863752.280381:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759324002304:12345-0@lo:400:kworker.0 Request processed in 72us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863752.280389:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788863752.280445:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324002560 00000100:00100000:2.0:1788863752.280449:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324002560 00000100:00100000:2.0:1788863752.280498:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788863752.280515:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759324002560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863752.280552:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759324002560:12345-0@lo:400:kworker.0 Request processed in 39us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863752.280558:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1788863752.280584:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863752.280726:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324002432:0@lo:400:kworker.0 00000100:00100000:0.0:1788863752.280760:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863752.280804:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324002688:0@lo:400:kworker.0 00000100:00100000:0.0:1788863752.280831:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863752.280889:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324002688 00000100:00100000:0.0:1788863752.280893:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324002688 00000100:00100000:0.0:1788863752.280943:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788863752.280950:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324002688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863752.280987:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324002688:12345-0@lo:400:kworker.0 Request processed in 38us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863752.281000:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788863752.281024:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863752.281438:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324002560:0@lo:400:kworker.0 00000100:00100000:1.0:1788863752.281507:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759324002304:0@lo:400:kworker.0 00000100:00100000:1.0:1788863752.281516:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759324002816:0@lo:400:kworker.0 00000100:00100000:1.0:1788863752.281543:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863752.281584:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324002432 00000100:00100000:1.0:1788863752.281588:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324002432 00000100:00100000:1.0:1788863752.281616:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324002816 00000100:00100000:1.0:1788863752.281619:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324002816 00000100:00100000:1.0:1788863752.281644:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788863752.281650:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324002432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863752.281683:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324002432:12345-0@lo:400:kworker.0 Request processed in 34us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863752.281714:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788863752.281728:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788863752.281733:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759324002816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863752.281767:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759324002816:12345-0@lo:400:kworker.0 Request processed in 33us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863752.281772:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788863752.281797:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759324002816:0@lo:400:kworker.0 00000100:00080000:0.0:1788863752.283218:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863752.283280:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324002432:0@lo:400:kworker.0 00000100:00100000:0.0:1788863752.283293:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324002944:0@lo:400:kworker.0 00000100:00100000:0.0:1788863752.283357:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863752.283415:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324002944 00000100:00100000:0.0:1788863752.283420:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324002944 00000100:00100000:0.0:1788863752.283467:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788863752.283475:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324002944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863752.283533:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324002944:12345-0@lo:400:kworker.0 Request processed in 58us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863752.283540:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788863752.283562:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863752.283580:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324002944:0@lo:400:kworker.0 00010000:00080000:2.0:1788863752.283928:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff745180 x1875759324002688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788863768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863752.283941:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324002688:0@lo:400:kworker.0 00000100:00100000:0.0:1788863752.285402:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863752.285426:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324003072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863752.285506:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863752.285564:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324003072 00000100:00100000:0.0:1788863752.285574:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324003072 00000100:00100000:0.0:1788863752.285673:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788863752.285683:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324003072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788863752.285945:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863752.285997:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324003072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 315us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863752.286024:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788863752.286152:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324003072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863752.383097:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863752.383172:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298799872 00000100:00100000:0.0:1788863752.383187:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298799872 00000100:00100000:0.0:1788863752.383923:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:0.0:1788863752.383939:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:10272:x1875759298799872:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863752.383971:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863752.384021:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbade4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e7e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384113:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384134:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384150:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384170:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbadf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384178:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbadf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384185:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbadf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384608:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384618:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadeb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384873:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384882:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0030200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863752.384888:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384899:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384915:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330900) 00010000:00010000:0.0:1788863752.384919:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863752.384926:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384933:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbadeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384949:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbadf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384955:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbadf2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384963:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbadf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384978:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863752.384981:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbadf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384988:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbadf2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.384998:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e8bcb0f5b00) 00010000:00010000:0.0:1788863752.385001:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863752.385004:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbadf2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.385011:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbadf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.385063:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbade4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e7e expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.385077:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330900) 00010000:00010000:0.0:1788863752.385079:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863752.385083:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbade4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e7e expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.385094:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030e00, rc 0) 00000100:00100000:0.0:1788863752.385204:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:10272:x1875759298799872:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1268us (2123us total) trans 0 rc 301/301 00000100:00100000:0.0:1788863752.385216:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00080000:0.0:1788863752.385268:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863752.395962:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863752.396458:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298800128 00000100:00100000:3.0:1788863752.396472:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298800128 00000100:00100000:3.0:1788863752.396556:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:3.0:1788863752.396568:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:10272:x1875759298800128:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:3.0:1788863752.396647:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863752.396685:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbad9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e69 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.396707:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330900) 00010000:00010000:3.0:1788863752.396722:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863752.397065:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbadf9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.397085:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbadf9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.397098:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbadf9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.397113:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbae00 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.397130:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbae00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.397137:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbae00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863752.398945:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788863752.398975:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbadf9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.398988:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbadf9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.398997:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbadf9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.399004:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863752.399009:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbadf9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.399018:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbadf9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.399042:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015900) 00010000:00010000:2.0:1788863752.399045:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863752.399051:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbadf9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.399070:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbadf9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863752.399097:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b433c7e reply state 0000000021366498 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbae00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863752.399110:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863752.399285:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:10272:x1875759298800128:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 2714us (3339us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788863752.399297:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00010000:00010000:2.0:1788863752.401440:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbae00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.401464:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbae00 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.401474:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbae00 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.401481:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863752.401487:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbae00 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.401495:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbae00 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.401517:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e8bc3015f00) 00010000:00010000:2.0:1788863752.401521:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863752.401527:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbae00 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.401547:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbae00 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863752.513619:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863752.513913:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298800256 00000100:00100000:3.0:1788863752.513930:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298800256 00000100:00100000:3.0:1788863752.514026:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:3.0:1788863752.514041:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:10280:x1875759298800256:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:3.0:1788863752.514085:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863752.514124:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbae07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.514235:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbae0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.514254:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbae0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.514270:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbae0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863752.514331:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788863752.514335:0:6707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863752.514393:0:6707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbae0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.514425:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbae07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e85 expref: 10 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.514472:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbae0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e85 expref: 9 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.514483:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015100) 00010000:00010000:3.0:1788863752.514486:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863752.516196:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17200, rc 0) 00000100:00100000:3.0:1788863752.516358:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:10280:x1875759298800256:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 2313us (2751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863752.516370:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:0.0:1788863752.597121:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863752.597184:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298800384 00000100:00100000:0.0:1788863752.597198:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298800384 00000100:00100000:0.0:1788863752.597389:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:0.0:1788863752.597404:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:10286:x1875759298800384:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788863752.597442:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863752.597478:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbae15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e8c expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.597572:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbae1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.597592:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbae1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.597607:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbae1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.597625:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbae23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.597632:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbae23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.597639:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbae23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.598139:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbae2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.598150:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbae2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.598178:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbae2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863752.598781:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788863752.598792:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788863752.598902:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbae2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.598921:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbae1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.598930:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbae1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.598940:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbae1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.598946:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863752.598953:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbae1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.598963:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbae1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.599174:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015100) 00010000:00010000:0.0:1788863752.599179:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863752.599187:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbae1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.599195:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbae1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.601312:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbae23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.601335:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbae23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.601344:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbae23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.601352:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863752.601358:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbae23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.601368:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbae23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.601392:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e8bcb0f5b00) 00010000:00010000:0.0:1788863752.601395:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863752.601402:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbae23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.601408:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbae23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.601482:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbae15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e8c expref: 11 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.601502:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbae2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e8c expref: 10 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.601526:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:0.0:1788863752.601528:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788863752.601531:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031200, rc 0) 00000100:00100000:0.0:1788863752.601676:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:10286:x1875759298800384:12345-192.168.204.51@tcp:101:bash.0 Request processed in 4273us (4572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863752.601687:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:0.0:1788863752.610288:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863752.610343:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298800640 00000100:00100000:0.0:1788863752.610357:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298800640 00000100:00100000:0.0:1788863752.610432:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1788863752.610452:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:10286:x1875759298800640:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788863752.610482:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863752.610522:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbae31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.610721:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbae38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.610740:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbae38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.610755:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbae38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.615168:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbae3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.615197:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbae3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.615232:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbae3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788863752.627301:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788863752.627699:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbae46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.627724:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbae46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.627742:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbae46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.627792:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbae38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.627801:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbae38 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.627810:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbae38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.627817:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0030e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863752.627823:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbae38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.627834:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbae38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.627873:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863752.627886:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863752.627894:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbae38 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.627901:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbae38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863752.627920:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004022d2c7 reply state 0000000029f52a7d transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbae3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863752.627932:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788863752.628046:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbae31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e93 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.628066:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbae46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e93 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.628075:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330f00) 00010000:00010000:2.0:1788863752.628078:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863752.628080:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554800, rc 0) 00000100:00100000:2.0:1788863752.628197:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:10286:x1875759298800640:12345-192.168.204.51@tcp:101:bash.0 Request processed in 17749us (17922us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788863752.628208:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00010000:00010000:0.0:1788863752.637209:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbae3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.637228:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbae3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.637237:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbae3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.637245:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166bc00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863752.637250:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbae3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.637259:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbae3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.637276:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bcb0f5000) 00010000:00010000:0.0:1788863752.637279:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863752.637284:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbae3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.637291:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbae3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863752.645587:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863752.645645:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298800768 00000100:00100000:1.0:1788863752.645659:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298800768 00000100:00100000:1.0:1788863752.645712:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1788863752.645725:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1875759298800768:12345-192.168.204.51@tcp:8:bash.0 00010000:00080000:1.0:1788863752.645767:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:1.0:1788863752.645810:0:6677:0:(genops.c:1384:class_connect()) connect: client 6fd3bcef-c680-4c25-aae1-ecd03903ad0a, cookie 0x744cd7666bbbae54 00002000:00100000:1.0:1788863752.645827:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6fd3bcef-c680-4c25-aae1-ecd03903ad0a/ffff8e8bffe56800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788863752.645898:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788863752.648818:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788863752.648904:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8e8bffe57000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863752.649020:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2349:x1875759298800768:12345-192.168.204.51@tcp:8:bash.0 Request processed in 3295us (3444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863752.649035:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:0.0:1788863752.659775:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863752.659896:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298800896 00000100:00100000:2.0:1788863752.659914:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298800896 00000100:00080000:0.0:1788863752.659986:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863752.660017:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1788863752.660032:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:0:x1875759298800896:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788863752.660057:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863752.660090:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a097955/0x744cd7666bbbae5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330e9a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863752.660146:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788863752.660172:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=381s v=(0 0) 00010000:00010000:2.0:1788863752.660176:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863752.660187:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a097955/0x744cd7666bbbae5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e9a expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.660213:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a097955/0x744cd7666bbbae5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e9a expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.660229:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554400, rc 0) 00000100:00100000:2.0:1788863752.660313:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:0:x1875759298800896:12345-192.168.204.51@tcp:101:bash.0 Request processed in 284us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863752.660333:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1788863752.667136:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863752.667249:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298801024 00000100:00100000:1.0:1788863752.667263:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298801024 00000100:00100000:1.0:1788863752.667376:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:1.0:1788863752.667388:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:10286:x1875759298801024:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788863752.667432:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863752.667462:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ea1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863752.667505:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a097955/0x744cd7666bbbae5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e9a expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863752.667517:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863752.667522:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863752.667527:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863752.667569:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a097955/0x744cd7666bbbae5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e9a expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863752.667586:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a097955/0x744cd7666bbbae5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e9a expref: 8 pid: 6679 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863752.667613:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1875759324003200:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863752.667722:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd0ff29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863752.674248:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863752.674456:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1875759324003200:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863752.674505:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863752.674534:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7ac00, rc 0) 00000100:00100000:1.0:1788863752.674633:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:10286:x1875759298801024:12345-192.168.204.51@tcp:101:bash.0 Request processed in 7245us (7512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863752.674644:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:2.0:1788863752.675570:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298801152 00000100:00100000:2.0:1788863752.675589:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298801152 00010000:00010000:2.0:1788863752.675655:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a097955/0x744cd7666bbbae5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e9a expref: 8 pid: 6679 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863752.675824:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:2.0:1788863752.675838:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff175180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298801152:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863752.675883:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863752.675919:0:8500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a097955/0x744cd7666bbbae5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e9a expref: 8 pid: 6679 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.675956:0:8500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a097955/0x744cd7666bbbae5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e9a expref: 8 pid: 6679 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.675989:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a097955/0x744cd7666bbbae5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e9a expref: 8 pid: 6679 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.676008:0:8500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863752.676013:0:8500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863752.676022:0:8500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.676033:0:8500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.676086:0:8500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863752.676108:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8500:1875759324003328:192.168.204.51@tcp:105: 00000100:00100000:2.0:1788863752.676231:0:8500:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff2356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863752.682152:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863752.682285:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8500:1875759324003328:192.168.204.51@tcp:105: 00010000:00010000:2.0:1788863752.682337:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863752.682627:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff175180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2350:x1875759298801152:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 6790us (8397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863752.682642:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:1.0:1788863752.682714:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298801408 00000100:00100000:1.0:1788863752.682724:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298801408 00000100:00100000:1.0:1788863752.682796:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1788863752.682808:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+12:10286:x1875759298801408:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:1.0:1788863752.683337:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:10286:x1875759298801408:12345-192.168.204.51@tcp:35:bash.0 Request processed in 528us (1198us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788863752.683345:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1788863752.804455:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863752.804727:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298801664 00000100:00100000:3.0:1788863752.804744:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298801664 00000100:00100000:3.0:1788863752.804835:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:3.0:1788863752.804894:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:10296:x1875759298801664:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788863752.804935:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863752.804964:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbae69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ea8 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863752.805100:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788863752.805287:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbae69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea8 expref: 15 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.805307:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015100) 00010000:00010000:3.0:1788863752.805311:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863752.805328:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbae69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea8 expref: 15 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863752.805371:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16000, rc 0) 00000100:00100000:3.0:1788863752.805457:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:10296:x1875759298801664:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 612us (1025us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788863752.805466:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:3.0:1788863752.810990:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863752.811130:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298801920 00000100:00100000:1.0:1788863752.811148:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298801920 00000100:00100000:2.0:1788863752.811505:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1788863752.811524:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:10296:x1875759298801920:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788863752.811983:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:10296:x1875759298801920:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 463us (1011us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788863752.811993:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1788863752.886596:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863752.886770:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298802048 00000100:00100000:2.0:1788863752.886784:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298802048 00000100:00100000:2.0:1788863752.886897:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:2.0:1788863752.886911:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:10302:x1875759298802048:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863752.886946:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863752.886976:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbae77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330eaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.887071:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbae7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.887089:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbae7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.887110:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbae7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863752.887163:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788863752.887167:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863752.887193:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbae7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.887447:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbae77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eaf expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.887496:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbae7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eaf expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.887506:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863752.887509:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863752.887514:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555e00, rc 0) 00000100:00100000:2.0:1788863752.887622:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:10302:x1875759298802048:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 713us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863752.887632:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:1.0:1788863752.893679:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863752.893806:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298802304 00000100:00100000:2.0:1788863752.893821:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298802304 00000100:00100000:2.0:1788863752.893932:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:2.0:1788863752.893944:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:10302:x1875759298802304:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863752.893974:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863752.894004:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbae85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330eb6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.894159:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbae8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.894179:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbae8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.894194:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbae8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863752.894207:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788863752.894411:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbae85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eb6 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.894435:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbae8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eb6 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.894446:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330f00) 00010000:00010000:2.0:1788863752.894449:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863752.894453:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555c00, rc 0) 00000100:00100000:2.0:1788863752.894545:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:10302:x1875759298802304:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 603us (893us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788863752.894555:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:3.0:1788863752.901000:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863752.901058:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863752.901165:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298802560 00000100:00100000:0.0:1788863752.901182:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298802560 00000100:00100000:0.0:1788863752.901276:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:0.0:1788863752.901288:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:10302:x1875759298802560:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863752.901339:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863752.901372:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbae9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ebd expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.901521:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbaea1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.901545:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbaea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.901564:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbaea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863752.901583:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788863752.901785:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbae9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ebd expref: 21 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.901808:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbaea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ebd expref: 20 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.901818:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330f00) 00010000:00010000:0.0:1788863752.901822:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788863752.901827:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc166bc00, rc 0) 00000100:00100000:0.0:1788863752.901962:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:10302:x1875759298802560:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 676us (978us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788863752.901991:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:1.0:1788863752.902281:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298802688 00000100:00100000:1.0:1788863752.902291:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298802688 00000100:00100000:1.0:1788863752.902359:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1788863752.902369:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:2353:x1875759298802688:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863752.902385:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863752.902405:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbae8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eb6 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863752.902419:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330f00) 00010000:00010000:1.0:1788863752.902423:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863752.902459:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:2353:x1875759298802688:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 93us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863752.902477:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1788863752.908757:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863752.913112:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298802816 00000100:00100000:2.0:1788863752.913139:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298802816 00000100:00100000:2.0:1788863752.913791:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:2.0:1788863752.913809:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2352:x1875759298802816:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:2.0:1788863752.914055:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.914083:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.914093:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788863752.914097:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863752.914102:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.914152:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863752.914190:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 7 pid: 6677 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863752.914470:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875759324003456:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863752.914620:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff2353c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863752.917682:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee337100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875759324003456:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863752.917732:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863752.918638:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863752.918747:0:6683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298802944 00000100:00100000:0.0:1788863752.918762:0:6683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298802944 00002000:00100000:0.0:1788863752.918833:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8e8bee337100 x1875759298802944/t0(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:738/0 lens 504/0 e 0 to 0 dl 1788863763 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863752.918845:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bee337100 with x1875759298802944 ext(0->12) 00010000:00010000:0.0:1788863752.918890:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 8 pid: 6677 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863752.918912:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 8 pid: 6677 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863752.918922:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e8bee337100 00000100:00100000:0.0:1788863752.918969:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:0.0:1788863752.918981:0:6683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298802944:12345-192.168.204.51@tcp:4:lfs.0 00000001:00100000:1.0:1788863752.964514:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000001:00080000:0.0:1788863753.019060:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788863753.022881:0:6683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2350:x1875759298802944:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 103865us (104217us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788863753.022908:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00002000:00100000:3.0:1788863753.022925:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8e8bee337100 x1875759298802944/t4294967299(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:738/0 lens 504/448 e 0 to 0 dl 1788863763 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788863753.022936:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bee337100 with x1875759298802944 ext(0->12) 00010000:00010000:3.0:1788863753.022950:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 7 pid: 6677 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.022971:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 7 pid: 6677 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788863753.022980:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e8bee337100 00000100:00100000:0.0:1788863753.036128:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863753.036360:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298803072 00000100:00100000:2.0:1788863753.036374:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298803072 00010000:00010000:2.0:1788863753.036445:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 7 pid: 6677 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863753.036542:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:2.0:1788863753.036555:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2353:x1875759298803072:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863753.036576:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788863753.036606:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788863753.036609:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788863751 00002000:00010000:2.0:1788863753.036612:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788863752 00002000:00010000:2.0:1788863753.036614:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788863751 00002000:00010000:2.0:1788863753.036617:0:5827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788863753.036625:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 7 pid: 6677 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.036641:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 7 pid: 6677 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.036704:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040dff5d6/0x744cd7666bbbae62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ea1 expref: 7 pid: 6677 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.036727:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863753.036731:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863753.036739:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.036750:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.036799:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863753.036935:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298803072:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 381us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863753.036944:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00010000:00010000:1.0:1788863753.037018:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.037030:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.037067:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.037077:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.037087:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.037094:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863753.037100:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.037110:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.037129:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.037146:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e2e5825/0x744cd7666bbbaeaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863753.037207:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2352:x1875759298802816:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 123405us (128466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863753.037217:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:2.0:1788863753.047079:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863753.047168:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298803328 00000100:00100000:1.0:1788863753.047182:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298803328 00000100:00100000:1.0:1788863753.047260:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1788863753.047271:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:10302:x1875759298803328:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:1.0:1788863753.047371:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbaea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ebd expref: 19 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863753.047825:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788863753.047926:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788863753.052325:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788863753.052499:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.052522:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbae46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e93 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.052531:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.052580:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbae46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e93 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.052617:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbae46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e93 expref: 23 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863753.052818:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23cb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1875759324003584:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863753.053654:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcb0920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863753.066658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863753.066986:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23cb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1875759324003584:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863753.067019:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863753.067056:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298803456 00000100:00100000:3.0:1788863753.067065:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298803456 00010000:00010000:3.0:1788863753.067110:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbae46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e93 expref: 24 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863753.067167:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:3.0:1788863753.067185:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:2350:x1875759298803456:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863753.067202:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863753.067211:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbae46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e93 expref: 24 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.067224:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbae46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e93 expref: 24 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.067247:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbae46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e93 expref: 24 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.067265:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330f00) 00010000:00010000:3.0:1788863753.067271:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.067279:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.067286:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.067321:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863753.067380:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:2350:x1875759298803456:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 197us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863753.067387:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00010000:00010000:1.0:1788863753.068724:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.068742:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863753.073395:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788863753.073704:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788863753.073831:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23cb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875759324003712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788863753.073999:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863753.074044:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcb092c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863753.074131:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324003712 00000100:00100000:2.0:1788863753.074153:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324003712 00000100:00100000:2.0:1788863753.074211:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863753.074221:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875759324003712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788863753.075716:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875759324003712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1488us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863753.075728:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863753.079982:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23cb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875759324003712:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788863753.083014:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788863753.083282:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23cb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875759324003840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788863753.083681:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863753.083725:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf3fc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863753.083767:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324003840 00000100:00100000:3.0:1788863753.083795:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324003840 00000100:00100000:3.0:1788863753.083866:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863753.083876:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875759324003840:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788863753.084444:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875759324003840:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 567us (761us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788863753.084454:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863753.084681:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23cb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875759324003840:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788863753.084759:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788863753.084801:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.084813:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.084821:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.084828:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7aa00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863753.084832:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.084840:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.084894:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330f00) 00010000:00010000:1.0:1788863753.084898:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788863753.084904:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.084910:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbaeb6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788863753.085094:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788863753.087518:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788863753.087553:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382216699500ns, next at 383216693387ns, rc = 0 00000001:00080000:1.0:1788863753.087573:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788863753.087666:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330f00) 00010000:00010000:1.0:1788863753.087672:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788863753.087700:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbaea1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ebd expref: 27 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863753.087896:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+26:10302:x1875759298803328:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 40624us (40830us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788863753.087907:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000020:00080000:1.0:1788863753.087914:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788863753.090451:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863753.090617:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298803584 00000100:00100000:0.0:1788863753.090628:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298803584 00000100:00100000:0.0:1788863753.090689:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:0.0:1788863753.090700:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+26:10302:x1875759298803584:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863753.090736:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863753.090764:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaebd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ec4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863753.090840:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaebd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ec4 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863753.090890:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaebd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ec4 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863753.090913:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:0.0:1788863753.090916:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863753.090920:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031e00, rc 0) 00000100:00100000:0.0:1788863753.090980:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:10302:x1875759298803584:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 281us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863753.090987:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:2.0:1788863753.101620:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863753.105541:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298803840 00000100:00100000:1.0:1788863753.105567:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298803840 00000100:00100000:3.0:1788863753.107936:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:3.0:1788863753.107957:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc2ed3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:10302:x1875759298803840:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1788863753.108252:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc2ed3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+28:10302:x1875759298803840:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 302us (6647us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788863753.108261:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00010000:00010000:0.0:1788863753.174022:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863753.216539:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863753.218146:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298804096 00000100:00100000:2.0:1788863753.218170:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298804096 00000100:00100000:2.0:1788863753.218235:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:2.0:1788863753.218246:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+28:10313:x1875759298804096:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863753.218275:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863753.218300:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbaec4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ecb expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863753.218578:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788863753.219454:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbaec4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ecb expref: 30 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.219473:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015100) 00010000:00010000:2.0:1788863753.219476:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863753.219482:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbaec4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ecb expref: 30 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.220051:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554200, rc 0) 00000100:00100000:2.0:1788863753.220144:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:10313:x1875759298804096:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1888us (3606us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788863753.220154:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:0.0:1788863753.227967:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863753.228098:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298804224 00000100:00100000:2.0:1788863753.228112:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298804224 00000100:00100000:2.0:1788863753.228190:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:2.0:1788863753.228203:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:10313:x1875759298804224:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1788863753.228296:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaed2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228341:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaed2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228353:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaed2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228367:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbaed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228383:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbaed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228389:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbaed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228475:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228483:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228490:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863753.228532:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228546:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaed2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228553:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaed2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228569:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaed2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228575:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863753.228579:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaed2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228587:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaed2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228601:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863753.228605:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863753.228609:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaed2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228615:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaed2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228630:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbaed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228637:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbaed9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228643:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbaed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228648:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863753.228651:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbaed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228667:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbaed9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228675:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bc9330e00) 00010000:00010000:2.0:1788863753.228677:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863753.228680:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbaed9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228686:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbaed9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228703:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228708:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228714:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228719:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863753.228722:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228728:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228735:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:2.0:1788863753.228737:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863753.228740:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.228758:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863753.229719:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:10313:x1875759298804224:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1512us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863753.229729:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:3.0:1788863753.233234:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863753.233315:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298804480 00000100:00100000:2.0:1788863753.233326:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298804480 00000100:00100000:2.0:1788863753.233395:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1788863753.233407:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:10313:x1875759298804480:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788863753.233712:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+30:10313:x1875759298804480:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 307us (490us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788863753.233720:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1788863753.309995:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863753.310708:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298804736 00000100:00100000:2.0:1788863753.310719:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298804736 00000100:00100000:2.0:1788863753.310785:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:2.0:1788863753.310800:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+30:10316:x1875759298804736:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863753.310834:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863753.310896:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ed2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311040:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaeee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311059:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaeee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311083:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaeee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311103:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311111:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311138:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311298:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaefc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311318:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaefc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311326:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaefc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863753.311336:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788863753.311527:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaeee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311536:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaeee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311543:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaeee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311550:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863753.311556:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaeee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311564:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaeee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311580:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:3.0:1788863753.311584:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863753.311597:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaeee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311604:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaeee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311622:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311629:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaef5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311634:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311640:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863753.311643:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311649:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaef5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311657:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bc3015c00) 00010000:00010000:3.0:1788863753.311660:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863753.311662:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaef5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311668:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaef5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311729:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbaee7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ed2 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311760:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaefc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ed2 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.311768:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:3.0:1788863753.311771:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863753.311773:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17000, rc 0) 00000100:00100000:3.0:1788863753.311981:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:10316:x1875759298804736:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1181us (1999us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788863753.311990:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:0.0:1788863753.322565:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863753.323224:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298804864 00000100:00100000:2.0:1788863753.323235:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298804864 00000100:00100000:2.0:1788863753.323314:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1788863753.323326:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:10316:x1875759298804864:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1788863753.323408:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.323441:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.323454:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.323483:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.323491:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.323498:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.323505:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863753.323511:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.323519:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.323532:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:2.0:1788863753.323535:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863753.323540:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.323546:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863753.323645:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:10316:x1875759298804864:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 320us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863753.323670:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1788863753.335163:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863753.335253:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298805120 00000100:00100000:3.0:1788863753.335266:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298805120 00000100:00100000:3.0:1788863753.335378:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788863753.335389:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:10316:x1875759298805120:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1788863753.335678:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+33:10316:x1875759298805120:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 289us (529us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788863753.335686:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788863753.698499:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863753.698668:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298805376 00000100:00100000:2.0:1788863753.698681:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298805376 00000100:00100000:2.0:1788863753.698763:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:2.0:1788863753.698776:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+33:10348:x1875759298805376:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:2.0:1788863753.698812:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863753.698840:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.699017:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbaf18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.699037:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbaf18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.699054:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbaf18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863753.699068:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788863753.699274:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ed9 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.699310:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbaf18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ed9 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.699321:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:2.0:1788863753.699324:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863753.699339:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554200, rc 0) 00000100:00100000:2.0:1788863753.699432:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:10348:x1875759298805376:12345-192.168.204.51@tcp:101:cat.0 Request processed in 658us (951us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788863753.699441:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1788863753.712529:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863753.712601:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863753.712754:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298805632 00000100:00100000:2.0:1788863753.712766:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298805632 00000100:00100000:2.0:1788863753.712835:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:2.0:1788863753.712846:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:10348:x1875759298805632:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:2.0:1788863753.713164:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+36:10348:x1875759298805632:12345-192.168.204.51@tcp:35:cat.0 Request processed in 319us (651us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788863753.713171:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1788863753.723316:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298805760 00000100:00100000:1.0:1788863753.723332:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298805760 00000100:00100000:1.0:1788863753.723414:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:1.0:1788863753.723426:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2887450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+36:2352:x1875759298805760:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863753.723442:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863753.723468:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbaf18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ed9 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863753.723489:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:1.0:1788863753.723495:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863753.723563:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2887450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:2352:x1875759298805760:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 140us (10961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863753.723570:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1788863753.805933:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863753.806227:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298806016 00000100:00100000:2.0:1788863753.806239:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298806016 00000100:00100000:2.0:1788863753.806320:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:2.0:1788863753.806331:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:10354:x1875759298806016:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:2.0:1788863753.806355:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863753.806359:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788863753.806385:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbae7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eaf expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.806408:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863753.806413:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863753.806427:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ee0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.806522:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.806556:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaefc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ed2 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.806565:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.806603:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaefc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ed2 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.806616:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaefc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ed2 expref: 35 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863753.806630:0:9496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcc000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9496:1875759324003968:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863753.806740:0:9496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd1e15000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863753.809522:0:9496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcc000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9496:1875759324003968:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863753.809553:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863753.811474:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863753.811555:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298806144 00000100:00100000:3.0:1788863753.811565:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298806144 00010000:00010000:3.0:1788863753.811604:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaefc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ed2 expref: 36 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863753.811645:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:3.0:1788863753.811655:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+36:2350:x1875759298806144:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863753.811669:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863753.811690:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaefc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ed2 expref: 36 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.811703:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaefc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ed2 expref: 36 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.811730:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaefc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ed2 expref: 36 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.811789:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:3.0:1788863753.811795:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.811805:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.811812:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863753.811848:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863753.811905:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.811914:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863753.811933:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:3.0:1788863753.812052:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+36:2350:x1875759298806144:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 397us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863753.812059:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00010000:00010000:2.0:1788863753.812101:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ee0 expref: 36 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.812129:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ee0 expref: 35 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.812137:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:2.0:1788863753.812140:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788863753.812143:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554c00, rc 0) 00000100:00100000:2.0:1788863753.812169:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:10354:x1875759298806016:12345-192.168.204.51@tcp:101:dd.0 Request processed in 5841us (6250us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788863753.812177:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:0.0:1788863753.820180:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863753.820287:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298806400 00000100:00100000:2.0:1788863753.820377:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298806400 00000100:00100000:2.0:1788863753.820452:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:2.0:1788863753.820463:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:10354:x1875759298806400:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:2.0:1788863753.820750:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.820767:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.821288:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788863753.821439:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788863753.821467:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bff951b reply state 000000003ea43147 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863753.821477:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863753.821586:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+38:10354:x1875759298806400:12345-192.168.204.51@tcp:36:dd.0 Request processed in 1124us (1417us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788863753.821594:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000020:00080000:2.0:1788863753.821600:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788863753.824401:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.824423:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.824432:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.824438:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863753.824444:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.824452:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.824471:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:2.0:1788863753.824474:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863753.824479:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863753.824486:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863754.047239:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863754.047300:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863754.047349:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863754.047524:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298806656 00000100:00100000:1.0:1788863754.047537:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298806656 00000100:00100000:1.0:1788863754.047604:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298806912 00000100:00100000:1.0:1788863754.047608:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298806912 00000100:00100000:1.0:1788863754.047637:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:1.0:1788863754.047648:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+37:2352:x1875759298806656:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863754.047750:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+37:2352:x1875759298806656:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 104us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863754.047759:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:1.0:1788863754.047779:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:1.0:1788863754.047786:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2352:x1875759298806912:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863754.047813:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2352:x1875759298806912:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863754.047819:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:2.0:1788863754.047933:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298806528 00000100:00100000:2.0:1788863754.047938:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298806528 00000100:00100000:2.0:1788863754.047978:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 288 00000100:00100000:2.0:1788863754.047985:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2353:x1875759298806528:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863754.048024:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2353:x1875759298806528:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 40us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863754.048030:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 288 00000100:00080000:0.0:1788863754.048258:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863754.063121:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863754.063454:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298806784 00000100:00100000:0.0:1788863754.063467:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298806784 00000100:00100000:0.0:1788863754.063552:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:0.0:1788863754.063563:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2353:x1875759298806784:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863754.063652:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2353:x1875759298806784:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 91us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863754.063660:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00080000:2.0:1788863754.063790:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788863754.198268:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863754.255320:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863754.255431:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298807040 00000100:00100000:2.0:1788863754.255446:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298807040 00000100:00100000:2.0:1788863754.255536:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:2.0:1788863754.255548:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+37:10368:x1875759298807040:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:2.0:1788863754.255573:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863754.255601:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ee7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.255714:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbaf49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.255732:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbaf49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.255746:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbaf49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.255763:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbaf50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.255771:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbaf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.255779:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbaf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.256186:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbaf57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.256201:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ee0 expref: 38 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.256210:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbaf57 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.256259:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ee0 expref: 38 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.256277:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ee0 expref: 38 pid: 9496 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863754.256306:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875759324004096:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863754.256437:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd1e15540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863754.267939:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863754.268405:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298807296 00000100:00100000:3.0:1788863754.268419:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298807296 00000100:00100000:3.0:1788863754.268494:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1788863754.268504:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+39:5592:x1875759298807296:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788863754.269035:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:5592:x1875759298807296:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 531us (1109us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788863754.269062:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1788863754.269953:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875759324004096:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863754.269984:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbaf57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863754.275504:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863754.275918:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298807424 00000100:00100000:1.0:1788863754.275932:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298807424 00010000:00010000:1.0:1788863754.275985:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ee0 expref: 40 pid: 9496 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863754.276034:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:1.0:1788863754.276046:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:2353:x1875759298807424:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863754.276061:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863754.276068:0:8500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ee0 expref: 40 pid: 9496 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.276083:0:8500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ee0 expref: 40 pid: 9496 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.276105:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbaf2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ee0 expref: 40 pid: 9496 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.276382:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:1.0:1788863754.276387:0:8500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbaf57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.276397:0:8500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbaf57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.276405:0:8500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbaf57 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.276486:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863754.276563:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+39:2353:x1875759298807424:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 518us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863754.276571:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00010000:00010000:0.0:1788863754.282014:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbaf57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282037:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbaf57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863754.282109:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788863754.282114:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788863754.282460:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbaf57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282481:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbaf57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282494:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbaf49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282500:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbaf49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282508:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbaf49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282532:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863754.282537:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbaf49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282547:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbaf49 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282565:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:0.0:1788863754.282569:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863754.282574:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbaf49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282581:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbaf49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282601:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbaf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282606:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbaf50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282612:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbaf50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282618:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863754.282620:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbaf50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.282626:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbaf50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.283242:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bc9330e00) 00010000:00010000:0.0:1788863754.283245:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863754.283249:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbaf50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.283256:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbaf50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.283322:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbaf42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ee7 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.283439:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbaf57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ee7 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.283447:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:0.0:1788863754.283449:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863754.283452:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555600, rc 0) 00000100:00100000:0.0:1788863754.283602:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+38:10368:x1875759298807040:12345-192.168.204.51@tcp:101:stat.0 Request processed in 28055us (28297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863754.283612:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000004:00080000:1.0:1788863754.326195:0:6706:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383455338671ns, next at 384455335899ns, rc = 0 00000100:00100000:0.0:1788863754.326243:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324004224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863754.326387:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863754.326909:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324004224 00000100:00100000:1.0:1788863754.326920:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324004224 00000100:00100000:1.0:1788863754.326989:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788863754.326999:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875759324004224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863754.327036:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863754.327100:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875759324004224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863754.327108:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788863754.327183:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863754.327361:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324004224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863754.364491:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863754.365401:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298807680 00000100:00100000:1.0:1788863754.365421:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298807680 00000100:00100000:1.0:1788863754.365517:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:1.0:1788863754.365530:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+38:10374:x1875759298807680:12345-192.168.204.51@tcp:36:truncate.0 00010000:00010000:1.0:1788863754.365600:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863754.365625:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbaf57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ee7 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.365645:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:1.0:1788863754.365650:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863754.367526:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.367553:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.367565:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863754.367662:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788863754.367688:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060ab2626 reply state 000000003643be95 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863754.367697:0:5841:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788863754.367877:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:10374:x1875759298807680:12345-192.168.204.51@tcp:36:truncate.0 Request processed in 2325us (3385us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788863754.367886:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000020:00080000:1.0:1788863754.367903:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788863754.374140:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.374422:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.374432:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.374461:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863754.374469:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.374479:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.374507:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:1.0:1788863754.374510:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863754.374517:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.374524:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863754.542812:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863754.543037:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298807808 00000100:00100000:3.0:1788863754.543052:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298807808 00000100:00100000:3.0:1788863754.543204:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:3.0:1788863754.543220:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+39:10388:x1875759298807808:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:3.0:1788863754.543272:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863754.543317:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaf65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330eee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543422:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaf6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543441:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaf6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543456:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaf6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543472:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaf73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543480:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaf73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543487:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaf73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543597:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543624:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543648:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863754.543709:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788863754.543715:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863754.543748:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543762:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543773:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaf6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543782:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaf6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543790:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaf6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543797:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863754.543802:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaf6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543810:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaf6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543826:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:3.0:1788863754.543835:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863754.543842:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaf6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543883:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbaf6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543904:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaf73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543911:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaf73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543917:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaf73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543922:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863754.543925:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaf73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543931:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaf73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543940:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bc3015c00) 00010000:00010000:3.0:1788863754.543943:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863754.543946:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaf73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543950:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbaf73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.543989:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbaf65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eee expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.544019:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eee expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.544026:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:3.0:1788863754.544029:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863754.544032:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17600, rc 0) 00000100:00100000:3.0:1788863754.544126:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:10388:x1875759298807808:12345-192.168.204.51@tcp:101:stat.0 Request processed in 907us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863754.544135:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:0.0:1788863754.628661:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863754.629006:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298808064 00000100:00100000:2.0:1788863754.629022:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298808064 00000100:00100000:2.0:1788863754.629131:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:2.0:1788863754.629147:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:10398:x1875759298808064:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863754.629184:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863754.629228:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbaf81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ef5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863754.629389:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788863754.629574:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbaf81 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ef5 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.629592:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015100) 00010000:00010000:2.0:1788863754.629595:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863754.629601:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbaf81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ef5 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.629618:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555400, rc 0) 00000100:00100000:2.0:1788863754.629714:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+41:10398:x1875759298808064:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 571us (1073us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788863754.629723:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:0.0:1788863754.636915:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863754.638451:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298808320 00000100:00100000:3.0:1788863754.638474:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298808320 00000100:00100000:3.0:1788863754.638571:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1788863754.638582:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+41:10398:x1875759298808320:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1788863754.638968:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+42:10398:x1875759298808320:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 385us (2127us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788863754.638977:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1788863754.711006:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863754.711326:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298808576 00000100:00100000:1.0:1788863754.711342:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298808576 00000100:00100000:1.0:1788863754.711441:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1788863754.711454:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+42:10404:x1875759298808576:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788863754.711491:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863754.711523:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbaf8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330efc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.711667:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.711686:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eee expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.711721:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.711772:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eee expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.711789:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eee expref: 43 pid: 5840 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863754.711816:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324004352:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863754.712443:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf3fccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863754.716712:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324004352:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863754.716759:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863754.722651:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863754.723527:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298808704 00000100:00100000:1.0:1788863754.723545:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298808704 00010000:00010000:1.0:1788863754.723617:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eee expref: 44 pid: 5840 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863754.723701:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:1.0:1788863754.723715:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+44:2350:x1875759298808704:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863754.723740:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863754.723749:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eee expref: 44 pid: 5840 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.723767:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eee expref: 44 pid: 5840 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.723800:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbaf7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330eee expref: 44 pid: 5840 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.724130:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:1.0:1788863754.724139:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.724153:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.724164:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.724211:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863754.724354:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+43:2350:x1875759298808704:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 642us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863754.724361:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00010000:00010000:2.0:1788863754.724595:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.724605:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863754.724642:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788863754.724926:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbaf8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330efc expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.724965:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330efc expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.724973:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:2.0:1788863754.724976:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788863754.724979:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a200, rc 0) 00000100:00100000:2.0:1788863754.725017:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+43:10404:x1875759298808576:12345-192.168.204.51@tcp:101:bash.0 Request processed in 13566us (14030us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788863754.725026:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1788863754.744380:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863754.744506:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298808960 00000100:00100000:3.0:1788863754.744520:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298808960 00000100:00100000:3.0:1788863754.744592:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:3.0:1788863754.744604:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+43:10404:x1875759298808960:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:3.0:1788863754.745104:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.745140:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863754.745155:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863754.745214:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788863754.745238:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9d6567f reply state 00000000fe21fc3e transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863754.745248:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863754.745378:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+46:10404:x1875759298808960:12345-192.168.204.51@tcp:36:bash.0 Request processed in 774us (1012us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788863754.745387:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000020:00080000:3.0:1788863754.745394:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788863754.754764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863754.756726:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298809088 00000100:00100000:1.0:1788863754.756750:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298809088 00000100:00100000:1.0:1788863754.756883:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:1.0:1788863754.756895:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+46:10404:x1875759298809088:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788863754.756930:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863754.756960:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbafab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f03 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.757338:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbafb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.757359:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330efc expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.757391:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.757400:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbafb2 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.757423:0:9496:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.757463:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330efc expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.757481:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330efc expref: 47 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863754.757499:0:9496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9496:1875759324004480:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863754.757626:0:9496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf3fccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863754.760308:0:9496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9496:1875759324004480:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863754.760353:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbafb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.764107:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.764134:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.764143:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.764150:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863754.764157:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.764166:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.764193:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:2.0:1788863754.764197:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863754.764202:0:3292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbafb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.764247:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.764255:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbafa4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863754.769098:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863754.769720:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298809216 00000100:00100000:1.0:1788863754.769736:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298809216 00010000:00010000:1.0:1788863754.769796:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330efc expref: 47 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863754.769879:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:1.0:1788863754.769914:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+47:2350:x1875759298809216:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863754.769940:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863754.769948:0:8500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330efc expref: 47 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.769966:0:8500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330efc expref: 47 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.770001:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbaf96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330efc expref: 47 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.770022:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:1.0:1788863754.770029:0:8500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbafb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.770044:0:8500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbafb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.770054:0:8500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbafb2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863754.770105:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863754.770201:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+46:2350:x1875759298809216:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 288us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863754.770209:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00010000:00010000:0.0:1788863754.771709:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbafb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.771729:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbafb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863754.771806:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788863754.771812:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788863754.771843:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbafb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.771952:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbafab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f03 expref: 46 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.771978:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbafb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f03 expref: 45 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.771989:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:0.0:1788863754.771993:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863754.771997:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7ac00, rc 0) 00000100:00100000:0.0:1788863754.772097:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+45:10404:x1875759298809088:12345-192.168.204.51@tcp:101:bash.0 Request processed in 15203us (17352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863754.772106:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:3.0:1788863754.776455:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863754.777406:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298809472 00000100:00100000:2.0:1788863754.777426:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298809472 00000100:00100000:2.0:1788863754.777558:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:2.0:1788863754.777572:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc2e8d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+45:10404:x1875759298809472:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1788863754.777953:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc2e8d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+46:10404:x1875759298809472:12345-192.168.204.51@tcp:35:bash.0 Request processed in 382us (1516us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788863754.777962:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1788863754.855030:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863754.855338:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298809728 00000100:00100000:2.0:1788863754.855484:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298809728 00000100:00100000:2.0:1788863754.855643:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:2.0:1788863754.855657:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+46:10414:x1875759298809728:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863754.856903:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863754.856944:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbafb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863754.857078:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788863754.857250:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbafb9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f0a expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.857267:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015100) 00010000:00010000:2.0:1788863754.858888:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863754.858908:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbafb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f0a expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.858938:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555400, rc 0) 00000100:00100000:2.0:1788863754.859058:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+47:10414:x1875759298809728:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 3403us (4043us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788863754.859072:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:3.0:1788863754.863712:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863754.865947:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298809856 00000100:00100000:2.0:1788863754.865970:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298809856 00000100:00100000:2.0:1788863754.866078:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:2.0:1788863754.866093:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+47:10414:x1875759298809856:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1788863754.866214:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbafc7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866237:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbafc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866256:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbafc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866285:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbafce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866294:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbafce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866301:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbafce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866448:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866479:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866487:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863754.866552:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866568:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbafc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866577:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbafc7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866585:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbafc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866593:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863754.866599:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbafc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866607:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbafc7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866622:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863754.866626:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863754.866632:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbafc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866640:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbafc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866669:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbafce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866676:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbafce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866682:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbafce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866688:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863754.866692:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbafce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866699:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbafce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866707:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bc9330500) 00010000:00010000:2.0:1788863754.866710:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863754.866713:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbafce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866719:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbafce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866741:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866749:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866756:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866767:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863754.866771:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866778:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866785:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:2.0:1788863754.866788:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863754.866791:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.866797:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863754.866962:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+47:10414:x1875759298809856:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 869us (3264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863754.866971:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:3.0:1788863754.871202:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863754.871379:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298810112 00000100:00100000:0.0:1788863754.871395:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298810112 00000100:00100000:0.0:1788863754.871484:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:0.0:1788863754.871495:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+47:10414:x1875759298810112:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788863754.871889:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+48:10414:x1875759298810112:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 395us (701us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788863754.871899:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:0.0:1788863754.927051:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863754.931199:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298810368 00000100:00100000:1.0:1788863754.931223:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298810368 00000100:00100000:0.0:1788863754.931517:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:0.0:1788863754.931530:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+48:10417:x1875759298810368:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863754.931583:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863754.931619:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbafdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f11 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.931737:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbafe3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.931755:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbafe3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.931771:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbafe3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.931785:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbafea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.931793:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbafea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.931800:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbafea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.931985:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaff1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932030:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932038:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863754.932050:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788863754.932206:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbafe3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932215:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbafe3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932222:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbafe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932229:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0030e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863754.932235:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbafe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932243:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbafe3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932258:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:0.0:1788863754.932262:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863754.932269:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbafe3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932285:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbafe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932303:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbafea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932316:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbafea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932322:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbafea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932326:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863754.932329:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbafea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932335:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbafea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932342:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bcb0f5b00) 00010000:00010000:0.0:1788863754.932345:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863754.932348:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbafea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932353:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbafea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932419:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbafdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f11 expref: 51 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932437:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaff1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f11 expref: 50 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.932445:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:0.0:1788863754.932448:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863754.932457:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031000, rc 0) 00000100:00100000:0.0:1788863754.933105:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:10417:x1875759298810368:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1572us (6067us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788863754.933115:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:3.0:1788863754.944027:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863754.944093:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863754.944210:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298810624 00000100:00100000:0.0:1788863754.944225:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298810624 00000100:00100000:0.0:1788863754.944325:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1788863754.944340:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:2352:x1875759298810624:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863754.944360:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863754.944399:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbaff1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f11 expref: 50 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863754.944425:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:0.0:1788863754.944431:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863754.944521:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+49:2352:x1875759298810624:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 185us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863754.944530:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:2.0:1788863754.947769:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298810496 00000100:00100000:2.0:1788863754.947792:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298810496 00000100:00100000:2.0:1788863754.947902:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:2.0:1788863754.947914:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+49:10417:x1875759298810496:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1788863754.948017:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.948041:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.948058:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.948118:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.948131:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.948140:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.948147:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863754.948152:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.948161:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.948179:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:2.0:1788863754.948183:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863754.948189:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863754.948196:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbafff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863754.948321:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+49:10417:x1875759298810496:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 409us (4311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863754.948330:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:3.0:1788863754.953021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863754.953117:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298810880 00000100:00100000:2.0:1788863754.953132:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298810880 00000100:00100000:2.0:1788863754.953204:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1788863754.953233:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+49:10417:x1875759298810880:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788863754.953602:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:10417:x1875759298810880:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 369us (595us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788863754.953612:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:1.0:1788863755.122242:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863755.122392:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298811136 00000100:00100000:3.0:1788863755.122406:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298811136 00000100:00100000:3.0:1788863755.122499:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:3.0:1788863755.122511:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:10435:x1875759298811136:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:3.0:1788863755.122552:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863755.123541:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb006 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f18 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.124980:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb00d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.125012:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.125824:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863755.125883:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788863755.126981:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f18 expref: 53 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.127013:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb00d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f18 expref: 52 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.127025:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:3.0:1788863755.127718:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788863755.127732:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16000, rc 0) 00000100:00100000:3.0:1788863755.127962:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10435:x1875759298811136:12345-192.168.204.51@tcp:101:cat.0 Request processed in 5447us (5797us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788863755.127976:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:0.0:1788863755.186359:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.187158:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298811264 00000100:00100000:2.0:1788863755.187247:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298811264 00000100:00100000:2.0:1788863755.187426:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:2.0:1788863755.187439:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10436:x1875759298811264:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863755.187474:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863755.187503:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb01b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f1f expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.187606:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.188413:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.188443:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863755.188503:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788863755.188508:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863755.188535:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.188576:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb01b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f1f expref: 54 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.188645:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f1f expref: 53 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.188658:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863755.188661:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863755.188666:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555800, rc 0) 00000100:00100000:2.0:1788863755.188766:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:10436:x1875759298811264:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1329us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863755.188775:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:0.0:1788863755.195241:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.195437:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298811648 00000100:00100000:2.0:1788863755.195452:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298811648 00000100:00100000:2.0:1788863755.195573:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1788863755.195588:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:10436:x1875759298811648:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788863755.196519:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:10436:x1875759298811648:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 927us (1353us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788863755.196531:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:1.0:1788863755.200415:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863755.200796:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298811776 00000100:00100000:0.0:1788863755.200810:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298811776 00000100:00100000:0.0:1788863755.200928:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1788863755.200939:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:10436:x1875759298811776:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:0.0:1788863755.200960:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788863755.200994:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbafb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f03 expref: 54 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.201045:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb00d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f18 expref: 53 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.201060:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031e00/0x744cd7666bbbaebd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ec4 expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.201072:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bcb0f5000) 00010000:00010000:0.0:1788863755.201084:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863755.201157:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+51:10436:x1875759298811776:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 219us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.201404:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1788863755.206977:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.207406:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298811904 00000100:00100000:2.0:1788863755.207421:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298811904 00000100:00100000:2.0:1788863755.207506:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:2.0:1788863755.207520:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+51:10436:x1875759298811904:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:2.0:1788863755.208006:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb029 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.208031:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb029 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.208061:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb029 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788863755.208532:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863755.208914:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788863755.209010:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788863755.209168:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+51:10436:x1875759298811904:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 1644us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863755.209181:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00010000:00010000:1.0:1788863755.222342:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863755.235127:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863755.235310:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298812032 00000100:00100000:1.0:1788863755.235324:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298812032 00000100:00100000:1.0:1788863755.235455:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:1.0:1788863755.235470:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+51:10438:x1875759298812032:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863755.235498:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863755.235544:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb030 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f26 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.235648:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb037 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.235667:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.235684:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.235706:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb03e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.235714:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb03e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.235721:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb03e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.235836:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.235846:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.235923:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863755.235968:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788863755.235974:0:6707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788863755.235996:0:6707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236009:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236017:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236024:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb037 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236030:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb037 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236037:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ba00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863755.236042:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb037 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236050:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb037 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236065:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:1.0:1788863755.236069:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863755.236075:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb037 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236093:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb037 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236110:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb03e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236116:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb03e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236122:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb03e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236128:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863755.236131:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb03e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236138:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb03e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236146:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bd20ddc00) 00010000:00010000:1.0:1788863755.236149:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863755.236151:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb03e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236158:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb03e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236199:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb030 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f26 expref: 53 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236214:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f26 expref: 52 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.236229:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330500) 00010000:00010000:1.0:1788863755.236231:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863755.236235:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7ac00, rc 0) 00000100:00100000:1.0:1788863755.236327:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10438:x1875759298812032:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 861us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863755.236336:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000040:00080000:3.0:1788863755.414771:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863755.414785:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863755.414843:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788863755.414880:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788863755.415083:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c13800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875759324004608:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788863755.415231:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc74ae9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863755.419621:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c13800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875759324004608:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788863755.421601:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.423123:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298812160 00000100:00100000:2.0:1788863755.423145:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298812160 00000100:00100000:2.0:1788863755.423299:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1788863755.423313:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10449:x1875759298812160:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788863755.423474:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10449:x1875759298812160:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 Request processed in 163us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863755.423483:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1788863755.429843:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.430015:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298812288 00000100:00100000:2.0:1788863755.430029:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298812288 00000100:00100000:2.0:1788863755.430149:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:2.0:1788863755.430164:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10449:x1875759298812288:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788863755.430216:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788863755.430384:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10449:x1875759298812288:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 223us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863755.430392:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:3.0:1788863755.439594:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863755.440307:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298812416 00000100:00100000:1.0:1788863755.440322:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298812416 00000100:00100000:1.0:1788863755.440406:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:1.0:1788863755.440419:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10449:x1875759298812416:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788863755.440522:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb04c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440545:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb04c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440560:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb04c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440579:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb053 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440588:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb053 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440594:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb053 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440650:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb05a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440660:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440668:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863755.440733:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788863755.440739:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788863755.440759:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440773:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb04c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440780:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb04c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440788:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb04c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440795:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ba00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863755.440800:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb04c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440808:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb04c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440822:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bcb0f5900) 00010000:00010000:1.0:1788863755.440831:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863755.440837:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb04c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440844:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb04c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440885:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb053 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440892:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb053 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440899:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb053 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440904:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7be00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863755.440907:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb053 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440913:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb053 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440921:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8e8bd20ddc00) 00010000:00010000:1.0:1788863755.440924:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863755.440927:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb053 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440932:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb053 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440947:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440960:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb05a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440966:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb05a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440971:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863755.440974:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb05a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440979:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb05a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440987:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330500) 00010000:00010000:1.0:1788863755.440990:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863755.440992:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb05a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.440998:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb05a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863755.441293:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10449:x1875759298812416:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 872us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863755.441303:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:3.0:1788863755.455781:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.457442:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298812672 00000100:00100000:2.0:1788863755.457464:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298812672 00000100:00100000:2.0:1788863755.457593:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:2.0:1788863755.457608:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10449:x1875759298812672:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863755.457641:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863755.457678:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb061 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f2d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.457830:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb068 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.457895:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.457911:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863755.457925:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788863755.458062:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.458072:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb068 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.458081:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.458088:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863755.458093:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.458101:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.458129:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330500) 00010000:00010000:2.0:1788863755.458132:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863755.458137:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb068 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.458144:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb068 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.458198:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb061 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f2d expref: 54 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.458210:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bcb0f5900) 00010000:00010000:2.0:1788863755.458213:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863755.458231:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb061 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f2d expref: 54 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.458243:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554a00, rc 0) 00000100:00100000:2.0:1788863755.458343:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:10449:x1875759298812672:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 738us (2578us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788863755.458352:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:3.0:1788863755.468369:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.468462:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298812800 00000100:00100000:2.0:1788863755.468480:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298812800 00000100:00100000:2.0:1788863755.468591:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:2.0:1788863755.468609:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:10449:x1875759298812800:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788863755.468679:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788863755.468835:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:10449:x1875759298812800:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 231us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863755.468882:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:3.0:1788863755.474421:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.474558:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298813056 00000100:00100000:2.0:1788863755.474572:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298813056 00000100:00100000:2.0:1788863755.474657:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:2.0:1788863755.474682:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:10449:x1875759298813056:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863755.474717:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863755.474721:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788863755.474762:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb022 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f1f expref: 53 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.474787:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863755.474793:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863755.474814:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb076 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f34 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788863755.475534:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788863755.475885:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb07d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.475905:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb07d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.475921:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb07d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.476008:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb076 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f34 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.476048:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb07d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f34 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.476058:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bc9330e00) 00010000:00010000:2.0:1788863755.476062:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863755.476065:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555400, rc 0) 00000100:00100000:2.0:1788863755.476177:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:10449:x1875759298813056:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1507us (1775us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788863755.476187:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:3.0:1788863755.482531:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863755.482845:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298813312 00000100:00100000:1.0:1788863755.482889:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298813312 00000100:00100000:1.0:1788863755.482966:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:1.0:1788863755.482989:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:10449:x1875759298813312:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788863755.483363:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863755.483424:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb07d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f34 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483454:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bc9330e00) 00010000:00010000:1.0:1788863755.483471:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863755.483504:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb08b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483522:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb08b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483535:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb08b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483556:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb092 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8734ff0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483563:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8734ff0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483695:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8734ff0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483791:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb08b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483801:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb08b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483810:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb08b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483817:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863755.483830:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb08b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483841:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb08b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483942:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:1.0:1788863755.483946:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863755.483951:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb08b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483959:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb08b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483975:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8734ff0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483981:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb092 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8734ff0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483988:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb092 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8734ff0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.483994:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7be00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863755.483997:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb092 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8734ff0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.484003:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb092 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8734ff0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.484011:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8734ff0a (ffff8e8bd20ddc00) 00010000:00010000:1.0:1788863755.484013:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863755.484027:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb092 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8734ff0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.484033:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb092 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8734ff0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863755.484961:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:10449:x1875759298813312:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1965us (2433us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788863755.484974:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:0.0:1788863755.493279:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863755.493421:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298813440 00000100:00100000:3.0:1788863755.493437:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298813440 00000100:00100000:3.0:1788863755.493628:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:3.0:1788863755.493642:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:10449:x1875759298813440:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863755.493686:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863755.493723:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb099 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f3b expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.493775:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb0a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.493792:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.493807:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.494011:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f3b expref: 55 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.494052:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f3b expref: 54 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.494064:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bc3015c00) 00010000:00010000:3.0:1788863755.494084:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788863755.494090:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16400, rc 0) 00000100:00100000:3.0:1788863755.494187:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:10449:x1875759298813440:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 546us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863755.494199:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:3.0:1788863755.498773:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.499177:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298813696 00000100:00100000:2.0:1788863755.499195:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298813696 00000100:00100000:2.0:1788863755.499355:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:2.0:1788863755.499369:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:10449:x1875759298813696:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788863755.499500:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb0a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.499524:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb0a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.499539:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb0a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788863755.500018:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788863755.500034:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384629181035ns, next at 385629177994ns, rc = 0 00000004:00010000:2.0:1788863755.500179:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000907ca75d reply state 0000000092ba2a2a transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb0a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863755.500219:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863755.500767:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:10449:x1875759298813696:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1396us (2006us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1788863755.500778:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00010000:00010000:0.0:1788863755.506685:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb0a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.506711:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb0a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.506720:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb0a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.506727:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863755.506733:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb0a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.506741:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb0a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.506876:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bc3015c00) 00010000:00010000:0.0:1788863755.506880:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788863755.506888:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb0a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.506895:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb0a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863755.514054:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863755.514157:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298813824 00000100:00100000:1.0:1788863755.514173:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298813824 00000100:00100000:1.0:1788863755.514246:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:1.0:1788863755.514259:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:10449:x1875759298813824:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788863755.515563:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863755.515604:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb0ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f42 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.515710:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb0ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f42 expref: 56 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.515730:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb0ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f42 expref: 56 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.515754:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bc3015c00) 00010000:00010000:1.0:1788863755.515758:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788863755.515763:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7be00, rc 0) 00000100:00100000:1.0:1788863755.515886:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:10449:x1875759298813824:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1629us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863755.515896:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:3.0:1788863755.520330:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863755.521107:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298813952 00000100:00100000:0.0:1788863755.521124:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298813952 00000100:00100000:0.0:1788863755.521203:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1788863755.521216:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1875759298813952:12345-192.168.204.51@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788863755.521273:0:6680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:0.0:1788863755.521323:0:6680:0:(genops.c:1384:class_connect()) connect: client 6fd3bcef-c680-4c25-aae1-ecd03903ad0a, cookie 0x744cd7666bbbb0b5 00002000:00100000:0.0:1788863755.521341:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6fd3bcef-c680-4c25-aae1-ecd03903ad0a/ffff8e8bd2996800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788863755.521377:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788863755.525306:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788863755.525436:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8e8bfb3aa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863755.525564:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2349:x1875759298813952:12345-192.168.204.51@tcp:8:lhsmtool_posix.0 Request processed in 4346us (5247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.525581:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1788863755.532485:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863755.532879:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298814080 00000100:00100000:1.0:1788863755.532894:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298814080 00000100:00100000:1.0:1788863755.532992:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:1.0:1788863755.533005:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:0:x1875759298814080:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788863755.535219:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1788863755.573074:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000001:00080000:0.0:1788863755.573104:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1788863755.573441:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:0:x1875759298814080:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 40429us (40962us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788863755.573454:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:3.0:1788863755.576414:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863755.582131:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298814336 00000100:00100000:0.0:1788863755.582149:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298814336 00000100:00100000:0.0:1788863755.582272:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1788863755.582285:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:10449:x1875759298814336:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788863755.582806:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:10449:x1875759298814336:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 520us (6403us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788863755.582816:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1788863755.587693:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863755.588993:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298814592 00000100:00100000:1.0:1788863755.589020:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298814592 00000100:00100000:1.0:1788863755.589182:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:1.0:1788863755.589196:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:10449:x1875759298814592:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788863755.589402:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:10449:x1875759298814592:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 208us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863755.589411:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:0.0:1788863755.592360:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.592462:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298814720 00000100:00100000:2.0:1788863755.592476:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298814720 00000100:00100000:2.0:1788863755.592551:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:2.0:1788863755.592564:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:10449:x1875759298814720:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863755.592590:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863755.592634:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb0bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f49 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.592904:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb0c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.592925:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.592941:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863755.592993:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863755.593022:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.593056:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb0bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f49 expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.593103:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f49 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.593112:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bc3015c00) 00010000:00010000:2.0:1788863755.593115:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788863755.593120:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554e00, rc 0) 00000100:00100000:2.0:1788863755.593194:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:10449:x1875759298814720:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 632us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863755.593203:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:1.0:1788863755.597509:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.597744:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298814848 00000100:00100000:2.0:1788863755.597758:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298814848 00000100:00100000:2.0:1788863755.598304:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:2.0:1788863755.598319:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298814848:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863755.598348:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863755.598383:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060ddca39/0x744cd7666bbbb0ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f50 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863755.598419:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe50a, blocks: 0x1 00010000:00010000:2.0:1788863755.598444:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788863755.598449:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863755.598461:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060ddca39/0x744cd7666bbbb0ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f50 expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.598486:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060ddca39/0x744cd7666bbbb0ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f50 expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.598522:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555600, rc 0) 00000100:00100000:2.0:1788863755.598661:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298814848:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 334us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863755.598669:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:0.0:1788863755.601820:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863755.602105:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298815104 00000100:00100000:1.0:1788863755.602121:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298815104 00000100:00100000:1.0:1788863755.602228:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:1.0:1788863755.602239:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:10449:x1875759298815104:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788863755.602429:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:10449:x1875759298815104:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 191us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863755.602439:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:3.0:1788863755.605628:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863755.605779:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298815232 00000100:00100000:0.0:1788863755.605792:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298815232 00000100:00100000:0.0:1788863755.606012:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:0.0:1788863755.606026:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:10449:x1875759298815232:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863755.606052:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863755.606077:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f57 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.606122:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060ddca39/0x744cd7666bbbb0ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f50 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.606134:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863755.606139:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863755.606145:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f57 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.606194:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060ddca39/0x744cd7666bbbb0ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f50 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.606233:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060ddca39/0x744cd7666bbbb0ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f50 expref: 7 pid: 6679 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863755.606254:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff137480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1875759324004736:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863755.606407:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788863755.610425:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863755.610543:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff137480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1875759324004736:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863755.610600:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f57 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.610647:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030200, rc 0) 00000100:00100000:0.0:1788863755.610743:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:10449:x1875759298815232:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 4718us (5145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.610755:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1788863755.612488:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298815360 00000100:00100000:1.0:1788863755.612511:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298815360 00010000:00010000:1.0:1788863755.612583:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060ddca39/0x744cd7666bbbb0ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f50 expref: 7 pid: 6679 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863755.612893:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:1.0:1788863755.612906:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc66f9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2350:x1875759298815360:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863755.612931:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863755.612971:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060ddca39/0x744cd7666bbbb0ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f50 expref: 7 pid: 6679 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.612989:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060ddca39/0x744cd7666bbbb0ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f50 expref: 7 pid: 6679 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.613029:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060ddca39/0x744cd7666bbbb0ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f50 expref: 7 pid: 6679 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.613055:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863755.613060:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863755.613073:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f57 expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.613099:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f57 expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.613160:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f57 expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863755.613180:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23c9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875759324004864:192.168.204.51@tcp:105: 00000100:00100000:1.0:1788863755.613340:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff2356c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863755.618311:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23c9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875759324004864:192.168.204.51@tcp:105: 00010000:00010000:2.0:1788863755.618355:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863755.618430:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc66f9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298815360:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 5526us (8024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863755.618448:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:0.0:1788863755.620684:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.620822:0:6685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298815488 00000100:00100000:2.0:1788863755.620837:0:6685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298815488 00002000:00100000:2.0:1788863755.620951:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e8bff137480 x1875759298815488/t0(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:741/0 lens 504/0 e 0 to 0 dl 1788863766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863755.620966:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bff137480 with x1875759298815488 ext(0->8) 00002000:00010000:2.0:1788863755.620973:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bff137480 00000100:00100000:2.0:1788863755.621018:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1788863755.621031:0:6685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298815488:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788863755.623998:0:6685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2351:x1875759298815488:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 2960us (3323us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788863755.624015:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00002000:00100000:2.0:1788863755.624028:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e8bff137480 x1875759298815488/t4294967302(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:741/0 lens 504/448 e 0 to 0 dl 1788863766 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863755.624051:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bff137480 with x1875759298815488 ext(0->8) 00002000:00010000:2.0:1788863755.624058:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bff137480 00000100:00100000:3.0:1788863755.627492:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863755.627675:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298815616 00000100:00100000:0.0:1788863755.627690:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298815616 00000100:00100000:0.0:1788863755.627777:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:0.0:1788863755.627791:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:10449:x1875759298815616:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788863755.687531:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1788863755.687578:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1788863755.687596:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788863755.688040:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:10449:x1875759298815616:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 60241us (60568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863755.688056:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:0.0:1788863755.688957:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863755.688989:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324004992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788863755.689079:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863755.689176:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324004992 00000100:00100000:0.0:1788863755.689187:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324004992 00000100:00100000:0.0:1788863755.689283:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788863755.689295:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875759324004992:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1788863755.689437:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8bcb092300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788863755.689444:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bd2933100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bc11ca0c0 00000020:00080000:2.0:1788863755.689447:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bd2933f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bd23f4400 00000004:00080000:2.0:1788863755.689491:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788863755.689785:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788863755.690007:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788863755.690138:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324005120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788863755.690207:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863755.690280:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324005120 00000100:00100000:2.0:1788863755.690287:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324005120 00000100:00100000:2.0:1788863755.690351:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788863755.690361:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324005120:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:0.0:1788863755.690627:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788863755.690641:0:10277:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788863755.690644:0:10277:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788863754 00002000:00010000:2.0:1788863755.690647:0:10277:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788863755.690649:0:10277:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788863754 -> 1788863754 00002000:00010000:2.0:1788863755.690652:0:10277:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1788863755.690763:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9fe507, atime: 0x6a9fe508, ctime: 0x6a9fe507, blocks: 0xb 00000100:00100000:2.0:1788863755.690764:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875759324005120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 404us (557us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788863755.690773:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1788863755.690774:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003217867a/0x744cd7666bbbb0d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.690794:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1788863755.690799:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00000100:00080000:2.0:1788863755.690805:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788863755.690806:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003217867a/0x744cd7666bbbb0d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.690826:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003217867a/0x744cd7666bbbb0d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.690839:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003217867a/0x744cd7666bbbb0d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788863755.690843:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8bffdcfb80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788863755.690849:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324005120:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788863755.690953:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003217867a/0x744cd7666bbbb0d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.691133:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863755.691220:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863755.691229:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003217867a/0x744cd7666bbbb0d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.691238:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031e00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863755.691243:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003217867a/0x744cd7666bbbb0d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.691255:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003217867a/0x744cd7666bbbb0d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.691292:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003217867a/0x744cd7666bbbb0d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.691301:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003217867a/0x744cd7666bbbb0d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.691324:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863755.691327:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863755.691328:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863755.691525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863755.691793:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1875759324004992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2498us (2714us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788863755.691804:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788863755.691824:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298815744 00000100:00100000:0.0:1788863755.691828:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298815744 00000100:00100000:0.0:1788863755.691903:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1788863755.691913:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298815744:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1788863755.693996:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8bff137b80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788863755.694018:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324004992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788863755.777927:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298815744:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 85997us (86387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.777945:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000001:00080000:0.0:1788863755.778209:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1788863755.778221:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788863755.782970:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863755.786833:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298816000 00000100:00100000:1.0:1788863755.786868:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298816000 00000100:00100000:1.0:1788863755.786955:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:1.0:1788863755.786969:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:10449:x1875759298816000:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788863755.787060:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863755.788275:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb0c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f49 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.788303:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bc3015c00) 00010000:00010000:1.0:1788863755.788312:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863755.788384:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb0df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.788407:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb0df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.788422:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb0df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863755.789597:0:9496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df2e932d reply state 000000003544b688 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb0df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863755.789631:0:9496:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788863755.792035:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:10449:x1875759298816000:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 5050us (9065us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788863755.792067:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00010000:00010000:0.0:1788863755.797626:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb0df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.797652:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb0df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.797662:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb0df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.797669:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863755.797676:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb0df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.797686:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb0df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.797711:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bc3015c00) 00010000:00010000:0.0:1788863755.797715:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863755.797722:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb0df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.797729:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb0df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863755.797876:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863755.798540:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298816128 00000100:00100000:0.0:1788863755.798557:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298816128 00000100:00100000:0.0:1788863755.798633:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:0.0:1788863755.798646:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298816128:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788863755.799093:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788863755.799099:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788863754 -> 1788863753 00002000:00010000:0.0:1788863755.799103:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788863752 00002000:00010000:0.0:1788863755.799105:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788863754 -> 1788863753 00002000:00010000:0.0:1788863755.799108:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788863755.799213:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2350:x1875759298816128:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 567us (1359us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788863755.799223:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:0.0:1788863755.816154:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863755.816240:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298816384 00000100:00100000:1.0:1788863755.816267:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298816384 00000100:00100000:1.0:1788863755.816356:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:1.0:1788863755.816369:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:10449:x1875759298816384:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788863755.816476:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.816502:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb0a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f3b expref: 13 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.816512:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.816561:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f3b expref: 13 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.816579:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f3b expref: 13 pid: 9496 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863755.816598:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6707:1875759324005248:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863755.816756:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863755.823519:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863755.823768:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298816512 00000100:00100000:0.0:1788863755.823783:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298816512 00010000:00010000:0.0:1788863755.823889:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb0a0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f3b expref: 14 pid: 9496 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863755.823943:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:0.0:1788863755.823956:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:2350:x1875759298816512:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863755.824587:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863755.824665:0:8500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb0a0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f3b expref: 14 pid: 9496 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.824688:0:8500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f3b expref: 14 pid: 9496 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.824744:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bc3015c00) 00010000:00010000:0.0:1788863755.824751:0:8500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.824764:0:8500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.824773:0:8500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.824799:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863755.824895:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:2350:x1875759298816512:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 940us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.824904:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00010000:00010000:0.0:1788863755.825906:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb0a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f3b expref: 13 pid: 9496 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863755.825934:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6707:1875759324005248:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863755.825964:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.826155:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.826165:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.826210:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.826232:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.826242:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.826248:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863755.826265:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.826274:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.826294:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bc3015c00) 00010000:00010000:0.0:1788863755.826297:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788863755.826302:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.826308:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb0e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863755.826388:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+12:10449:x1875759298816384:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 10022us (10252us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788863755.826399:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:1.0:1788863755.840942:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863755.841086:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298816640 00000100:00100000:0.0:1788863755.841103:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298816640 00000100:00100000:0.0:1788863755.841180:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:0.0:1788863755.841194:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2352:x1875759298816640:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788863755.841271:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.841315:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f57 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.841324:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863755.841329:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863755.841334:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.841413:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f57 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.841433:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f57 expref: 7 pid: 6677 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863755.841453:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1875759324005376:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863755.841659:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2d66a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863755.845410:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1875759324005376:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863755.845474:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863755.846444:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863755.846610:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298816768 00000100:00100000:3.0:1788863755.846628:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298816768 00010000:00010000:3.0:1788863755.846689:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f57 expref: 8 pid: 6677 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863755.846749:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:3.0:1788863755.846761:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2351:x1875759298816768:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863755.846802:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863755.846839:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f57 expref: 8 pid: 6677 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.846902:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f57 expref: 8 pid: 6677 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.846940:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018e1a57f/0x744cd7666bbbb0d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f57 expref: 8 pid: 6677 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.846965:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863755.846969:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863755.846989:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.847000:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.847035:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863755.847115:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298816768:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 355us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863755.847124:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00010000:00010000:0.0:1788863755.847394:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.847408:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.847441:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.847468:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.847478:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.847485:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863755.847490:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.847501:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.847515:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.847535:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067cbde52/0x744cd7666bbbb0ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863755.847616:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2352:x1875759298816640:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 6425us (6691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.847625:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:1.0:1788863755.858179:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863755.858273:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298817024 00000100:00100000:2.0:1788863755.858289:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298817024 00000100:00100000:2.0:1788863755.858371:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:2.0:1788863755.858383:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+12:10449:x1875759298817024:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788863755.858558:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb0f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.858581:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb0f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.858596:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb0f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.858973:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.858987:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb0ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f42 expref: 13 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.858996:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.859043:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb0ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f42 expref: 13 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.859063:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb0ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f42 expref: 13 pid: 6707 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863755.859107:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324005504:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863755.859230:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bee4e0900 going to sleep for 11 seconds 00000100:00100000:1.0:1788863755.862686:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324005504:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863755.862707:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:1.0:1788863755.862743:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863755.864978:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298817152 00000100:00100000:3.0:1788863755.865000:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298817152 00010000:00010000:3.0:1788863755.865069:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb0ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f42 expref: 14 pid: 6707 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863755.865212:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:2.0:1788863755.865230:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:2350:x1875759298817152:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863755.865263:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863755.865274:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb0ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f42 expref: 14 pid: 6707 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.865291:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb0ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f42 expref: 14 pid: 6707 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.865325:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb0ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f42 expref: 14 pid: 6707 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.865350:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bc3015c00) 00010000:00010000:2.0:1788863755.865357:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.865368:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.865378:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863755.865421:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863755.865631:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.865641:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863755.865773:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:2350:x1875759298817152:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 549us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863755.865783:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000001:00080000:1.0:1788863755.865937:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788863755.866564:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788863755.866625:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788863755.866765:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875759324005632:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788863755.866844:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863755.867153:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8be1ed4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788863755.867944:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324005632 00000100:00100000:2.0:1788863755.867959:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324005632 00000100:00100000:2.0:1788863755.868041:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863755.868052:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875759324005632:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788863755.868214:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875759324005632:12345-0@lo:1000:mdt00_001.0 Request processed in 163us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863755.868223:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863755.868287:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788863755.868294:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8bffdcfb80, transno 4294967303 00000100:00100000:1.0:1788863755.868365:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875759324005632:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788863755.869189:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788863755.869316:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875759324005760:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788863755.869374:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863755.869418:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc74ae9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863755.869525:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324005760 00000100:00100000:3.0:1788863755.869535:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324005760 00000100:00100000:3.0:1788863755.869593:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788863755.869613:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875759324005760:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788863755.869916:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875759324005760:12345-0@lo:1000:mdt00_001.0 Request processed in 314us (540us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788863755.869924:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863755.870335:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875759324005760:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788863755.870402:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.870418:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.870441:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.870449:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863755.870456:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.870466:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.870489:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bc3015c00) 00010000:00010000:1.0:1788863755.870493:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788863755.870500:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.870507:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb0fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.871214:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb029 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.871226:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb029 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.871234:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb029 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.871240:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863755.871244:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb029 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.871278:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb029 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.871295:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330500) 00010000:00010000:1.0:1788863755.871297:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788863755.871301:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb029 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.871307:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb029 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.871373:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.871391:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f26 expref: 16 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.871401:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.871448:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f26 expref: 16 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.871468:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f26 expref: 16 pid: 6707 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863755.871486:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca960a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324005888:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863755.873666:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc74ae9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863755.886909:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863755.887080:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298817280 00000100:00100000:0.0:1788863755.887095:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298817280 00010000:00010000:0.0:1788863755.887150:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f26 expref: 17 pid: 6707 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863755.887220:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:0.0:1788863755.887233:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+17:2350:x1875759298817280:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863755.887266:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863755.887275:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f26 expref: 17 pid: 6707 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.887290:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f26 expref: 17 pid: 6707 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.887324:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330500) 00010000:00010000:0.0:1788863755.887330:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.887344:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.887353:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.887379:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863755.887449:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+17:2350:x1875759298817280:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 217us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863755.887457:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00010000:00010000:1.0:1788863755.892819:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f26 expref: 16 pid: 6707 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863755.892901:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca960a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324005888:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863755.892944:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.892957:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.892964:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.892994:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893002:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893011:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893019:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ba00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863755.893024:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893033:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893056:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330500) 00010000:00010000:1.0:1788863755.893059:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863755.893066:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893083:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb102 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893097:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb0f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893103:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb0f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893110:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb0f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893115:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863755.893118:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb0f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893123:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb0f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893133:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330500) 00010000:00010000:1.0:1788863755.893135:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788863755.893138:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb0f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863755.893144:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb0f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863755.893550:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:10449:x1875759298817024:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 35164us (35382us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788863755.893563:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00000020:00080000:1.0:1788863755.893580:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788863755.894896:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863755.894910:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863755.894947:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788863755.894956:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788863755.897719:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863755.898553:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298817536 00000100:00100000:0.0:1788863755.898570:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298817536 00000100:00100000:0.0:1788863755.898652:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:0.0:1788863755.898665:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:10449:x1875759298817536:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788863755.899607:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788863755.899739:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788863755.899801:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb109 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.899822:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb109 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.899838:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb109 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.899848:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb109 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.899893:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb109 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.899900:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb109 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863755.899936:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863755.900045:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863755.900055:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb109 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.900063:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031400 already unused, calling callback (ffffffffc1577930) 00000100:00100000:0.0:1788863755.900067:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+17:10449:x1875759298817536:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 1402us (2366us total) trans 4294967362 rc 0/0 00010000:00010000:3.0:1788863755.900068:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb109 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.900078:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb109 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863755.900078:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000020:00080000:0.0:1788863755.900085:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788863755.900094:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8bcb0f5600) 00010000:00010000:3.0:1788863755.900097:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788863755.900103:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb109 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.900109:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb109 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863755.900129:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863755.900140:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863755.900141:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788863756.136897:0:12001:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788863756.136911:0:12001:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788863756.136955:0:12001:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788863756.136962:0:12001:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788863756.246956:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863756.275344:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863756.275474:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298817792 00000100:00100000:1.0:1788863756.275491:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298817792 00000100:00100000:1.0:1788863756.275649:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:1.0:1788863756.275675:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+17:10459:x1875759298817792:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863756.275720:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863756.275754:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f5e expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.277994:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb117 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.278033:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb117 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.278057:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb117 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863756.278079:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788863756.278311:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f5e expref: 20 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.278333:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb117 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f5e expref: 19 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.278343:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:1.0:1788863756.278364:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788863756.278368:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7ac00, rc 0) 00000100:00100000:1.0:1788863756.278461:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:10459:x1875759298817792:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 2789us (3134us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788863756.278472:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00080000:3.0:1788863756.279311:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863756.287229:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863756.287335:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298817920 00000100:00100000:1.0:1788863756.287348:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298817920 00000100:00100000:1.0:1788863756.287429:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:1.0:1788863756.287442:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:10459:x1875759298817920:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:1.0:1788863756.287568:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb125 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.287593:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb125 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.287610:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb125 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.287627:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb12c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.287634:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb12c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.287641:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb12c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.287991:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb133 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288000:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288017:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863756.288074:0:6707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288091:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb125 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288098:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb125 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288106:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb125 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288113:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863756.288119:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb125 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288129:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb125 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288145:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:1.0:1788863756.288149:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863756.288154:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb125 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288162:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb125 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288175:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb12c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288190:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb12c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288197:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb12c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288202:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863756.288205:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb12c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288212:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb12c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288221:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bd20ddc00) 00010000:00010000:1.0:1788863756.288224:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863756.288226:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb12c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288232:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb12c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288265:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288272:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb133 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288277:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288281:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863756.288291:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288298:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288306:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:1.0:1788863756.288309:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863756.288311:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb133 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.288317:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb133 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863756.288431:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:10459:x1875759298817920:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 989us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863756.288442:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:0.0:1788863756.348168:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863756.348392:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298818176 00000100:00100000:1.0:1788863756.348404:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298818176 00000100:00100000:1.0:1788863756.348470:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:1.0:1788863756.348480:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:10462:x1875759298818176:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863756.348507:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863756.348534:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb13a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f65 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.348618:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb141 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.348634:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.348657:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.348685:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.348693:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.348700:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349000:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb14f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349009:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349015:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863756.349027:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788863756.349163:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349171:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb141 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349179:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349185:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863756.349197:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349205:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb141 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349218:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:1.0:1788863756.349222:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863756.349226:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349232:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349254:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349260:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349265:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349270:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863756.349272:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349277:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349490:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bd20ddb00) 00010000:00010000:1.0:1788863756.349492:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863756.349502:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb148 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349507:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349558:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb13a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f65 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349573:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb14f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f65 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.349581:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:1.0:1788863756.349583:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863756.349585:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7ba00, rc 0) 00000100:00100000:1.0:1788863756.349658:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:10462:x1875759298818176:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1179us (1509us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788863756.349724:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:2.0:1788863756.356425:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863756.364355:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298818304 00000100:00100000:1.0:1788863756.364373:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298818304 00000100:00100000:1.0:1788863756.364499:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:1.0:1788863756.364511:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:10462:x1875759298818304:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:1.0:1788863756.364600:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb15d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.364619:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.364631:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.365817:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.365834:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb15d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.365842:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb15d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.365868:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863756.365875:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb15d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.365883:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb15d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.365899:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:1.0:1788863756.365903:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863756.365908:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb15d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.365915:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb15d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863756.366039:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:10462:x1875759298818304:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 1525us (9620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863756.366048:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:3.0:1788863756.372376:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863756.372503:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298818560 00000100:00100000:2.0:1788863756.372516:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298818560 00000100:00100000:2.0:1788863756.373167:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:2.0:1788863756.373181:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc2e8c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:10462:x1875759298818560:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788863756.373535:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc2e8c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+22:10462:x1875759298818560:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 357us (1169us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788863756.373549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788863756.415034:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863756.415162:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298818816 00000100:00100000:2.0:1788863756.415174:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298818816 00000100:00100000:2.0:1788863756.415262:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:2.0:1788863756.415275:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+22:9990:x1875759298818816:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788863756.415330:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863756.415362:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb164 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.415599:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.415619:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb14f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f65 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.415628:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.415679:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb14f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f65 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.415696:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb14f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f65 expref: 23 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863756.415713:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c11880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875759324006016:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863756.415845:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bee4e06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863756.431885:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863756.431938:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298818944 00000100:00100000:3.0:1788863756.431949:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298818944 00000100:00100000:0.0:1788863756.431966:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c11880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875759324006016:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863756.432000:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.432001:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb14f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f65 expref: 24 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863756.432052:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:3.0:1788863756.432063:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:2350:x1875759298818944:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863756.432082:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863756.432091:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb14f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f65 expref: 24 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.432103:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb14f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f65 expref: 24 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.432277:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb14f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f65 expref: 24 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.432300:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:3.0:1788863756.432305:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.432316:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.432344:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.432379:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863756.432410:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.432420:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863756.432442:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:3.0:1788863756.432448:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:2350:x1875759298818944:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 384us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863756.432458:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00010000:00010000:0.0:1788863756.432636:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb164 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f6c expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.432803:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f6c expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.432812:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:0.0:1788863756.432815:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788863756.432818:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554800, rc 0) 00000100:00100000:0.0:1788863756.432886:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:9990:x1875759298818816:12345-192.168.204.51@tcp:101:bash.0 Request processed in 17614us (17868us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788863756.432896:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:0.0:1788863756.444990:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863756.445091:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298819200 00000100:00100000:1.0:1788863756.445104:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298819200 00000100:00100000:1.0:1788863756.445191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:1.0:1788863756.445216:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:9990:x1875759298819200:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:1.0:1788863756.445547:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb179 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.445564:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.445661:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863756.445745:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788863756.445779:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c983164 reply state 0000000062597f6e transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863756.445788:0:5841:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788863756.445833:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788863756.446109:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:9990:x1875759298819200:12345-192.168.204.51@tcp:36:bash.0 Request processed in 891us (1130us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788863756.446118:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 89 00000020:00080000:1.0:1788863756.446125:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788863756.450806:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:2.0:1788863756.451020:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.451039:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb179 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.451047:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb179 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.451054:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863756.451060:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb179 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.451088:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb179 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.451106:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:2.0:1788863756.451110:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863756.451116:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb179 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.451122:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb179 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863756.451380:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298819328 00000100:00100000:1.0:1788863756.451395:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298819328 00000100:00100000:0.0:1788863756.451524:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:0.0:1788863756.451536:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+26:9990:x1875759298819328:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788863756.451565:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863756.451593:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f73 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.451676:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f73 expref: 27 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.451705:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f73 expref: 27 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.451727:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:0.0:1788863756.451730:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863756.451733:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031000, rc 0) 00000100:00100000:0.0:1788863756.452200:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:9990:x1875759298819328:12345-192.168.204.51@tcp:101:bash.0 Request processed in 595us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863756.452211:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:1.0:1788863756.459746:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863756.461313:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298819456 00000100:00100000:0.0:1788863756.461333:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298819456 00000100:00100000:0.0:1788863756.461410:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:0.0:1788863756.461423:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:9990:x1875759298819456:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788863756.461449:0:10277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863756.461480:0:10277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003217867a/0x744cd7666bbbb187 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f7a expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863756.461509:0:10277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9fe509, atime: 0x6a9fe508, ctime: 0x6a9fe509, blocks: 0xb 00010000:00010000:0.0:1788863756.461536:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1788863756.461542:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863756.461551:0:10277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003217867a/0x744cd7666bbbb187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f7a expref: 7 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.461599:0:10277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003217867a/0x744cd7666bbbb187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f7a expref: 7 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.461612:0:10277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031e00, rc 0) 00000100:00100000:0.0:1788863756.461812:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:9990:x1875759298819456:12345-192.168.204.51@tcp:101:bash.0 Request processed in 391us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863756.461819:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:3.0:1788863756.465284:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863756.465419:0:6683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298819584 00000100:00100000:0.0:1788863756.465430:0:6683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298819584 00002000:00010000:0.0:1788863756.465476:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1788863756.465481:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bffcfed80 with x1875759298819584 ext(0->18446744073709551615) 00002000:00010000:0.0:1788863756.465495:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bffcfed80. 00000100:00100000:0.0:1788863756.465536:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:0.0:1788863756.465546:0:6683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298819584:12345-192.168.204.51@tcp:10:bash.0 00002000:00010000:0.0:1788863756.466002:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788863756.466008:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788863753 -> 1788863755 00002000:00010000:0.0:1788863756.466011:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788863752 -> 1788863752 00002000:00010000:0.0:1788863756.466013:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788863753 -> 1788863755 00002000:00010000:0.0:1788863756.466016:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788863756.466078:0:6683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2351:x1875759298819584:12345-192.168.204.51@tcp:10:bash.0 Request processed in 533us (804us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788863756.466087:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00002000:00010000:0.0:1788863756.466091:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1788863756.466095:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bffcfed80 with x1875759298819584 ext(0->18446744073709551615) 00002000:00010000:0.0:1788863756.466120:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bffcfed80. 00000100:00100000:1.0:1788863756.540104:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863756.540447:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298819712 00000100:00100000:0.0:1788863756.540457:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298819712 00000100:00100000:0.0:1788863756.540519:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:0.0:1788863756.540530:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:10476:x1875759298819712:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:0.0:1788863756.540849:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb18e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.540903:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb18e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.540916:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb18e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.540933:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb195 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.540939:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.540945:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.542521:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb19c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.542543:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.542556:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863756.542821:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.542837:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb18e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.542844:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb18e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.542934:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb18e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.542942:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863756.542946:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb18e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.542954:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb18e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.542967:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:0.0:1788863756.542970:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863756.542975:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb18e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.542981:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb18e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.542998:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543004:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb195 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543017:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543021:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0030200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863756.543024:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543030:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb195 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543038:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bcb0f5000) 00010000:00010000:0.0:1788863756.543041:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863756.543043:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb195 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543049:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb195 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543071:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543077:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb19c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543082:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb19c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543086:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0030e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863756.543089:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb19c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543104:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb19c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543111:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:0.0:1788863756.543113:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863756.543116:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb19c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.543121:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb19c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863756.544680:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:10476:x1875759298819712:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 4132us (4569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863756.544695:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:1.0:1788863756.591952:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863756.592081:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298819968 00000100:00100000:2.0:1788863756.592094:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298819968 00000100:00100000:2.0:1788863756.592449:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:2.0:1788863756.592472:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:10479:x1875759298819968:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863756.592499:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863756.592528:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb1a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f81 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.592620:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.592641:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.592653:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.592681:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.592711:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.592719:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593033:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb1b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593043:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593050:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863756.593061:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788863756.593169:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593176:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593183:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593189:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863756.593193:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593200:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593221:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863756.593224:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863756.593229:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593235:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593269:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593275:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593290:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593296:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863756.593299:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593304:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593312:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bc9330b00) 00010000:00010000:2.0:1788863756.593314:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863756.593317:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593323:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593378:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb1a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f81 expref: 30 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593393:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f81 expref: 29 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.593400:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:2.0:1788863756.593402:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788863756.593405:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554200, rc 0) 00000100:00100000:2.0:1788863756.593483:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:10479:x1875759298819968:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1016us (1546us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788863756.593492:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:1.0:1788863756.596532:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863756.600550:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298820096 00000100:00100000:0.0:1788863756.600566:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298820096 00000100:00100000:0.0:1788863756.600629:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:0.0:1788863756.600640:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:10479:x1875759298820096:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1788863756.600731:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.600749:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f6c expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.600760:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.600795:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f6c expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.600831:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f6c expref: 29 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863756.600845:0:9496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9496:1875759324006144:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863756.600961:0:9496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc9376000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863756.605566:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863756.605756:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298820352 00000100:00100000:3.0:1788863756.605771:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298820352 00000100:00100000:3.0:1788863756.605898:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:3.0:1788863756.605912:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+30:5592:x1875759298820352:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788863756.606451:0:9496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9496:1875759324006144:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863756.606493:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863756.607092:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+31:5592:x1875759298820352:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 1175us (1537us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788863756.607106:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:1.0:1788863756.612832:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863756.613458:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298820480 00000100:00100000:0.0:1788863756.613476:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298820480 00010000:00010000:0.0:1788863756.613557:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f6c expref: 31 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863756.613625:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:0.0:1788863756.613638:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+31:2351:x1875759298820480:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863756.613664:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863756.613672:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f6c expref: 31 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.613690:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f6c expref: 31 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.613725:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb16b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f6c expref: 31 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.613778:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:0.0:1788863756.613785:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.613797:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.613810:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.614118:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863756.614207:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+30:2351:x1875759298820480:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 570us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863756.614217:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00010000:00010000:1.0:1788863756.614386:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.614411:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.614464:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.614473:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.614481:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.614488:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0030e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863756.614495:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.614504:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.614515:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:1.0:1788863756.614518:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863756.614522:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.614528:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863756.614732:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:10479:x1875759298820096:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 13944us (18065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863756.614747:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:3.0:1788863756.617092:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863756.619100:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298820736 00000100:00100000:2.0:1788863756.619128:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298820736 00000100:00100000:2.0:1788863756.619216:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:2.0:1788863756.619229:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:10479:x1875759298820736:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788863756.619583:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+30:10479:x1875759298820736:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 355us (2505us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788863756.619592:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:2.0:1788863756.729764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863756.729905:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298820992 00000100:00100000:0.0:1788863756.729918:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298820992 00000100:00100000:0.0:1788863756.730001:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:0.0:1788863756.730014:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+30:10490:x1875759298820992:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:0.0:1788863756.730047:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863756.730072:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb1cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.730161:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb1d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.730178:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.730192:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.730228:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.730250:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.730259:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.732049:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbb1e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.732072:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbb1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.732086:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbb1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863756.732101:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788863756.732270:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.733354:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb1d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.733365:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb1d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.733568:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863756.733575:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb1d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734020:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb1d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734043:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:0.0:1788863756.734046:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863756.734052:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb1d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734058:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb1d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734078:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734084:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734091:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734097:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0030e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863756.734100:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734106:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734113:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bcb0f5000) 00010000:00010000:0.0:1788863756.734116:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863756.734118:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734136:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030e00/0x744cd7666bbbb1db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734208:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb1cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f88 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734224:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbb1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f88 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.734232:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:0.0:1788863756.734235:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863756.734253:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc166bc00, rc 0) 00000100:00100000:0.0:1788863756.735776:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:10490:x1875759298820992:12345-192.168.204.51@tcp:101:cat.0 Request processed in 5754us (6014us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788863756.735788:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:1.0:1788863756.745355:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863756.745483:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298821248 00000100:00100000:0.0:1788863756.745788:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298821248 00000100:00100000:0.0:1788863756.745956:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:0.0:1788863756.745967:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:10490:x1875759298821248:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:0.0:1788863756.746206:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+33:10490:x1875759298821248:12345-192.168.204.51@tcp:35:cat.0 Request processed in 240us (865us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788863756.746214:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:1.0:1788863756.763146:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863756.763315:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298821504 00000100:00100000:2.0:1788863756.763330:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298821504 00000100:00100000:2.0:1788863756.763742:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:2.0:1788863756.763754:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+33:10491:x1875759298821504:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:2.0:1788863756.763825:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788863756.763908:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbb1e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f88 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.763933:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb1b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f81 expref: 32 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.763947:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f73 expref: 31 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.763957:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:2.0:1788863756.763967:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863756.763989:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.764003:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.764013:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.764026:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.764033:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.764039:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.764309:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb1fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.764327:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb1fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.764336:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb1fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788863756.765001:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788863756.765011:0:6707:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385894158386ns, next at 386894156061ns, rc = 0 00010000:00010000:2.0:1788863756.765069:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb205 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765079:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765087:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765094:0:6707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb205 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765101:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb205 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765107:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765128:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863756.765149:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb1fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765155:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb1fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765168:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb1fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765174:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863756.765178:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb1fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765185:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb1fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765195:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330d00) 00010000:00010000:2.0:1788863756.765198:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788863756.765202:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb1fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765208:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb1fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765227:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765233:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765254:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765259:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863756.765262:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765279:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765287:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863756.765290:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863756.765293:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.765298:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb1f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863756.765309:0:6707:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000589961d1 reply state 00000000dc34bdc8 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863756.765318:0:6707:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863756.765406:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:10491:x1875759298821504:12345-192.168.204.51@tcp:36:rm.0 Request processed in 1649us (2269us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788863756.765416:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00010000:00010000:1.0:1788863756.766198:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863756.766216:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb205 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.766229:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555a00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863756.766246:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb205 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.766258:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.766281:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8bc9330d00) 00010000:00010000:1.0:1788863756.766284:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788863756.766289:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb205 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.766296:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb205 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.766331:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863756.766334:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863756.766337:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863756.768430:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.768455:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.768490:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.768497:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863756.768503:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.768513:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.768537:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bc9330b00) 00010000:00010000:0.0:1788863756.768541:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863756.768546:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.768553:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb1f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863756.809463:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863756.810050:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298821760 00000100:00100000:0.0:1788863756.810065:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298821760 00000100:00100000:0.0:1788863756.810151:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:0.0:1788863756.810164:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+31:10497:x1875759298821760:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788863756.810199:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863756.810234:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbb20c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f8f expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.810425:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb213 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.810469:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb213 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.810500:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb213 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.810526:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb21a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.810534:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb21a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.810551:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb21a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788863756.811452:0:9496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788863756.811693:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.811705:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.811714:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.811749:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb213 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.811755:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb213 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.811761:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb213 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.811773:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc166a400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863756.811778:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb213 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.811784:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb213 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.811796:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:0.0:1788863756.811798:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863756.811802:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb213 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.811807:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb213 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863756.811820:0:9496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000083b13d7 reply state 0000000001570ad7 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb21a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863756.811827:0:9496:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788863756.812041:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbb20c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f8f expref: 34 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.812057:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f8f expref: 33 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.812063:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:0.0:1788863756.812066:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863756.812069:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030200, rc 0) 00000100:00100000:0.0:1788863756.812210:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+34:10497:x1875759298821760:12345-192.168.204.51@tcp:101:bash.0 Request processed in 2047us (2761us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788863756.812226:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00010000:00010000:2.0:1788863756.818687:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb21a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.818715:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb21a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.818725:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb21a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.818731:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863756.818738:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb21a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.818777:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb21a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.818800:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bcb0f5000) 00010000:00010000:2.0:1788863756.818803:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863756.818810:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb21a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.818817:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb21a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863756.819083:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863756.820935:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298821888 00000100:00100000:2.0:1788863756.820956:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298821888 00000100:00100000:2.0:1788863756.821086:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:2.0:1788863756.821100:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2353:x1875759298821888:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788863756.821132:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863756.821173:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bab043c/0x744cd7666bbbb22f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f96 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863756.821217:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788863756.821281:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1788863756.821287:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863756.821300:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bab043c/0x744cd7666bbbb22f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f96 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.821325:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bab043c/0x744cd7666bbbb22f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f96 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788863756.821341:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788863756.821366:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555c00, rc 0) 00000100:00100000:2.0:1788863756.821459:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298821888:12345-192.168.204.51@tcp:101:bash.0 Request processed in 362us (2382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863756.821468:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:1.0:1788863756.828010:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863756.828267:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298822016 00000100:00100000:0.0:1788863756.828290:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298822016 00000100:00100000:0.0:1788863756.828453:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:0.0:1788863756.828466:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:10497:x1875759298822016:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788863756.828497:0:10277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863756.828523:0:10277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330f9d expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.828567:0:10277:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009bab043c/0x744cd7666bbbb22f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f96 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.828578:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863756.828583:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863756.828589:0:10277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 7 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.828642:0:10277:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009bab043c/0x744cd7666bbbb22f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f96 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.828662:0:10277:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009bab043c/0x744cd7666bbbb22f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f96 expref: 7 pid: 6680 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863756.828684:0:10277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10277:1875759324006272:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863756.828902:0:10277:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc12ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863756.831785:0:10277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10277:1875759324006272:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863756.831838:0:10277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 7 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.831898:0:10277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0030e00, rc 0) 00000100:00100000:0.0:1788863756.831982:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:10497:x1875759298822016:12345-192.168.204.51@tcp:101:bash.0 Request processed in 3517us (3992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863756.831995:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:1.0:1788863756.838184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863756.838358:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298822144 00000100:00100000:3.0:1788863756.838372:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298822144 00010000:00010000:3.0:1788863756.838431:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009bab043c/0x744cd7666bbbb22f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f96 expref: 7 pid: 6680 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863756.838493:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:3.0:1788863756.838505:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc66f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298822144:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863756.838528:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863756.838562:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009bab043c/0x744cd7666bbbb22f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f96 expref: 7 pid: 6680 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.838608:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009bab043c/0x744cd7666bbbb22f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f96 expref: 7 pid: 6680 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.838731:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bab043c/0x744cd7666bbbb22f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f96 expref: 7 pid: 6680 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.838761:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863756.838767:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863756.838778:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.838791:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.839303:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863756.839329:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5827:1875759324006400:192.168.204.51@tcp:105: 00000100:00100000:3.0:1788863756.839450:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff2356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863756.843267:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5827:1875759324006400:192.168.204.51@tcp:105: 00010000:00010000:3.0:1788863756.843307:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863756.843386:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc66f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298822144:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 4881us (5220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863756.843399:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:1.0:1788863756.846671:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863756.846799:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298822400 00000100:00100000:2.0:1788863756.846814:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298822400 00000100:00100000:2.0:1788863756.846924:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:2.0:1788863756.846936:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+33:10497:x1875759298822400:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1788863756.847607:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+34:10497:x1875759298822400:12345-192.168.204.51@tcp:35:bash.0 Request processed in 669us (947us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788863756.847618:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1788863756.958345:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863756.958724:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298822528 00000100:00100000:0.0:1788863756.958741:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298822528 00000100:00100000:0.0:1788863756.958916:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:0.0:1788863756.958932:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+34:10513:x1875759298822528:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863756.958970:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863756.959016:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb23d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330fa4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.959210:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.959230:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.959256:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863756.959306:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788863756.959311:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788863756.959363:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.959397:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031400/0x744cd7666bbbb23d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fa4 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.959424:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fa4 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.959436:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:0.0:1788863756.959440:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788863756.959444:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc0031000, rc 0) 00000100:00100000:0.0:1788863756.959593:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:10513:x1875759298822528:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 663us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863756.959601:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:1.0:1788863756.965097:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863756.965505:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298822784 00000100:00100000:2.0:1788863756.965519:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298822784 00000100:00100000:2.0:1788863756.965951:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:2.0:1788863756.965967:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:10513:x1875759298822784:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863756.966009:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863756.966042:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb24b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330fab expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.966210:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb252 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.966240:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.966257:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863756.966283:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788863756.966481:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb24b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fab expref: 38 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.966505:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb252 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fab expref: 37 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.966516:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:2.0:1788863756.966519:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863756.966524:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554200, rc 0) 00000100:00100000:2.0:1788863756.966644:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+37:10513:x1875759298822784:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 682us (1566us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788863756.966653:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:0.0:1788863756.970189:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863756.970956:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863756.970993:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298823168 00000100:00100000:0.0:1788863756.971009:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298823168 00000100:00100000:0.0:1788863756.971359:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1788863756.971374:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+37:2351:x1875759298823168:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863756.971401:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863756.971446:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb252 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fab expref: 37 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863756.971477:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:0.0:1788863756.971484:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863756.971574:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+36:2351:x1875759298823168:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 204us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863756.971616:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1788863756.972803:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298823040 00000100:00100000:1.0:1788863756.972818:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298823040 00000100:00100000:1.0:1788863756.972919:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:1.0:1788863756.972930:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+36:10513:x1875759298823040:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863756.972963:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863756.972991:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb260 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330fb2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.973273:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb267 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.973293:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.973307:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863756.973324:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788863756.973512:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb260 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fb2 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.973536:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb267 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fb2 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863756.973546:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:1.0:1788863756.973550:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788863756.973555:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b600, rc 0) 00000100:00100000:1.0:1788863756.973801:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+38:10513:x1875759298823040:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 872us (3627us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788863756.973831:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:0.0:1788863756.984021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863756.984125:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298823296 00000100:00100000:3.0:1788863756.984141:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298823296 00000100:00100000:3.0:1788863756.984292:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:3.0:1788863756.984306:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298823296:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:3.0:1788863756.984606:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.984648:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.984670:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788863756.984675:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863756.984681:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.984737:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.984761:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 6 pid: 10277 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863756.984779:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1875759324006528:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788863756.985020:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff235480 going to sleep for 11 seconds 00000100:00100000:3.0:1788863756.989426:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1875759324006528:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788863756.989473:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863756.991802:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863756.991994:0:6685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298823424 00000100:00100000:2.0:1788863756.992010:0:6685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298823424 00002000:00100000:2.0:1788863756.992089:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e8bedc8ea00 x1875759298823424/t0(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:742/0 lens 504/0 e 0 to 0 dl 1788863767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863756.992103:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bedc8ea00 with x1875759298823424 ext(0->8) 00010000:00010000:2.0:1788863756.992115:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 7 pid: 10277 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.992138:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 7 pid: 10277 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863756.992147:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e8bedc8ea00 00000100:00100000:2.0:1788863756.992189:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1788863756.992222:0:6685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2350:x1875759298823424:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:2.0:1788863756.992945:0:6685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2350:x1875759298823424:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 720us (1153us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788863756.992955:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00002000:00100000:2.0:1788863756.992964:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e8bedc8ea00 x1875759298823424/t4294967302(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:742/0 lens 504/448 e 0 to 0 dl 1788863767 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863756.992973:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bedc8ea00 with x1875759298823424 ext(0->8) 00010000:00010000:2.0:1788863756.992981:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 9 pid: 10277 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.992997:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 9 pid: 10277 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863756.993005:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e8bedc8ea00 00000100:00100000:0.0:1788863756.996204:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863756.996561:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298823552 00000100:00100000:2.0:1788863756.996586:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298823552 00010000:00010000:2.0:1788863756.996664:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 9 pid: 10277 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863756.996728:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:2.0:1788863756.996742:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2351:x1875759298823552:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863756.996766:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788863756.996802:0:8500:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788863756.996806:0:8500:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788863755 00002000:00010000:2.0:1788863756.996809:0:8500:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788863756 00002000:00010000:2.0:1788863756.996834:0:8500:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788863755 00010000:00010000:2.0:1788863756.996843:0:8500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 9 pid: 10277 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.997066:0:8500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 9 pid: 10277 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.997111:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053bd0297/0x744cd7666bbbb236 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f9d expref: 9 pid: 10277 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.997137:0:8500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863756.997141:0:8500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863756.997149:0:8500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.997160:0:8500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.997255:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863756.997350:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2351:x1875759298823552:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 611us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863756.997359:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00010000:00010000:3.0:1788863756.999143:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863756.999169:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.999568:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.999714:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.999754:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.999763:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863756.999769:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.999781:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.999808:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863756.999817:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070223abe/0x744cd7666bbbb275 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863757.000158:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2353:x1875759298823296:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 15848us (16153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863757.000172:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1788863757.003911:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863757.004026:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298823808 00000100:00100000:2.0:1788863757.004040:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298823808 00000100:00100000:2.0:1788863757.004123:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:2.0:1788863757.004135:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc2e8d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+38:10513:x1875759298823808:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:2.0:1788863757.004225:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb267 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fb2 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788863757.004651:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788863757.004690:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788863757.005149:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788863757.005217:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.005253:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb221 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f8f expref: 42 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.005265:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.005313:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f8f expref: 42 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.005334:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f8f expref: 42 pid: 9496 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863757.005354:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875759324006656:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863757.005471:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bee4e0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788863757.009574:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863757.010075:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875759324006656:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863757.010128:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863757.012784:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298823936 00000100:00100000:0.0:1788863757.012809:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298823936 00010000:00010000:1.0:1788863757.013189:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f8f expref: 43 pid: 9496 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863757.013304:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:1.0:1788863757.013318:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+43:2351:x1875759298823936:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863757.013342:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863757.013351:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f8f expref: 43 pid: 9496 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.013368:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f8f expref: 43 pid: 9496 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.013401:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030200/0x744cd7666bbbb221 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f8f expref: 43 pid: 9496 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.013425:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:1.0:1788863757.013432:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.013445:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.013455:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.013549:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863757.013695:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+42:2351:x1875759298823936:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 379us (4139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863757.013704:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00010000:00010000:2.0:1788863757.015360:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.015384:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788863757.015630:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788863757.016017:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788863757.016184:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875759324006784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788863757.016293:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863757.016343:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bee4e0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788863757.016534:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324006784 00000100:00100000:3.0:1788863757.016544:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324006784 00000100:00100000:3.0:1788863757.016632:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788863757.016645:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5844:x1875759324006784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788863757.016757:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5844:x1875759324006784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 114us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863757.016765:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788863757.016823:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875759324006784:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788863757.017451:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788863757.017539:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875759324006912:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788863757.017592:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863757.017621:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd0e41f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863757.017641:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324006912 00000100:00100000:3.0:1788863757.017647:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324006912 00000100:00100000:3.0:1788863757.017678:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863757.017687:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5844:x1875759324006912:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788863757.017907:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5844:x1875759324006912:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 220us (314us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788863757.017926:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863757.017975:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875759324006912:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788863757.018032:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1788863757.018076:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.018089:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.018097:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.018104:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863757.018110:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.018118:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.018138:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:3.0:1788863757.018141:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788863757.018147:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.018153:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb27c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788863757.018369:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788863757.018497:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1788863757.018512:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386147659698ns, next at 387147656800ns, rc = 0 00000001:00080000:3.0:1788863757.018528:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1788863757.018565:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:3.0:1788863757.018570:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788863757.018580:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb267 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fb2 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863757.018741:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc2e8d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+45:10513:x1875759298823808:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 14607us (14845us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1788863757.018751:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000020:00080000:3.0:1788863757.018758:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788863757.019062:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863757.022196:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863757.022338:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298824064 00000100:00100000:0.0:1788863757.022351:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298824064 00000100:00100000:1.0:1788863757.022762:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:1.0:1788863757.022776:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+45:10513:x1875759298824064:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863757.022824:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863757.022896:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb283 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330fb9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.022993:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb283 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fb9 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.023012:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb283 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fb9 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.023036:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:1.0:1788863757.023040:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788863757.023045:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7be00, rc 0) 00000100:00100000:1.0:1788863757.023119:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+46:10513:x1875759298824064:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 346us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863757.023128:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:0.0:1788863757.029207:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863757.029336:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298824320 00000100:00100000:3.0:1788863757.029351:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298824320 00000100:00100000:3.0:1788863757.029433:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1788863757.029446:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+46:10513:x1875759298824320:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788863757.030534:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+47:10513:x1875759298824320:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 1082us (1335us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788863757.030548:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1788863757.125836:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863757.126240:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298824448 00000100:00100000:1.0:1788863757.126257:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298824448 00000100:00100000:1.0:1788863757.126365:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:1.0:1788863757.126380:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+47:10523:x1875759298824448:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:1.0:1788863757.126526:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb28a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.126587:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb28a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.126606:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb28a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.126953:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.126964:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.126972:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127106:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127115:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127123:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863757.127188:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127204:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb28a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127211:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb28a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127244:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb28a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127252:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7aa00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863757.127257:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb28a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127266:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb28a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127282:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:1.0:1788863757.127286:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863757.127294:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb28a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127431:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb28a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127448:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127456:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb291 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127462:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127467:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863757.127470:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127488:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb291 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127497:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bd20dd300) 00010000:00010000:1.0:1788863757.127499:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863757.127503:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb291 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127510:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127528:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127535:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb298 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127541:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127546:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863757.127548:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127554:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127560:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:1.0:1788863757.127562:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863757.127565:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb298 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.127591:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863757.128114:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+47:10523:x1875759298824448:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1730us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863757.128126:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:1.0:1788863757.184416:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863757.188968:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298824704 00000100:00100000:3.0:1788863757.188993:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298824704 00000100:00100000:3.0:1788863757.189319:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:3.0:1788863757.189334:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+47:10526:x1875759298824704:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788863757.189367:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863757.189405:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb29f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330fc0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.189514:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb2a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.189534:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb2a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.189577:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb2a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.189598:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb2ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.189605:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb2ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.189612:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb2ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.189795:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb2b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.189805:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.189813:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863757.189825:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788863757.189993:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb2a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190001:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb2a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190009:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb2a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190016:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863757.190030:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb2a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190040:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb2a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190055:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:3.0:1788863757.190058:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863757.190065:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb2a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190072:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb2a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190104:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb2ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190111:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb2ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190118:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb2ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190124:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863757.190128:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb2ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190134:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb2ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190142:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bc3015800) 00010000:00010000:3.0:1788863757.190144:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863757.190154:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb2ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190161:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb2ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190217:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb29f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc0 expref: 50 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190246:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc0 expref: 49 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.190254:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:3.0:1788863757.190257:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863757.190260:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16e00, rc 0) 00000100:00100000:3.0:1788863757.190373:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+49:10526:x1875759298824704:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1042us (5973us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788863757.190383:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:0.0:1788863757.197412:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863757.197541:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298824832 00000100:00100000:1.0:1788863757.197557:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298824832 00000100:00100000:1.0:1788863757.197651:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:1.0:1788863757.197664:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+49:10526:x1875759298824832:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:1.0:1788863757.197783:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb2c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.197808:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.197823:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.198022:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.198032:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb2c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.198040:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.198047:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863757.198074:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.198083:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb2c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.198099:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:1.0:1788863757.198102:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863757.198108:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb2c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.198116:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb2c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863757.198213:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+49:10526:x1875759298824832:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 550us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863757.198222:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:1.0:1788863757.202802:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863757.203145:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298825088 00000100:00100000:0.0:1788863757.203162:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298825088 00000100:00100000:2.0:1788863757.203437:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:2.0:1788863757.203454:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+49:10526:x1875759298825088:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788863757.204033:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:10526:x1875759298825088:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 581us (1249us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788863757.204044:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:0.0:1788863757.272138:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863757.272353:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298825344 00000100:00100000:1.0:1788863757.272368:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298825344 00000100:00100000:1.0:1788863757.272451:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:1.0:1788863757.272463:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:10536:x1875759298825344:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788863757.272500:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863757.272506:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788863757.272549:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031000/0x744cd7666bbbb244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fa4 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.272590:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:1.0:1788863757.272597:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863757.272650:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb2c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330fc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.272820:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.272841:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb2b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc0 expref: 50 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.272946:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.273006:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc0 expref: 50 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.273024:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb2b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc0 expref: 50 pid: 9496 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.273031:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863757.273057:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff07f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324007040:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863757.273924:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc74ae9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863757.277149:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff07f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324007040:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863757.277200:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863757.279424:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863757.280298:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298825472 00000100:00100000:3.0:1788863757.280317:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298825472 00010000:00010000:3.0:1788863757.280383:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb2b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc0 expref: 51 pid: 9496 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863757.280447:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:3.0:1788863757.280461:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+51:2351:x1875759298825472:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863757.280482:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863757.280492:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb2b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc0 expref: 51 pid: 9496 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.280538:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc0 expref: 51 pid: 9496 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.280783:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb2b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc0 expref: 51 pid: 9496 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.280814:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:3.0:1788863757.280821:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.280834:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.280844:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.281013:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863757.281116:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:2351:x1875759298825472:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 656us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863757.281126:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00010000:00010000:1.0:1788863757.282513:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.282532:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863757.282597:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788863757.282978:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb2c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc7 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.283007:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc7 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.283017:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:1.0:1788863757.283020:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788863757.283024:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7aa00, rc 0) 00000100:00100000:1.0:1788863757.283366:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:10536:x1875759298825344:12345-192.168.204.51@tcp:101:bash.0 Request processed in 10902us (11245us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788863757.283379:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:3.0:1788863757.286696:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863757.287303:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298825728 00000100:00100000:1.0:1788863757.287322:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298825728 00000100:00100000:1.0:1788863757.287454:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 105 00000100:00100000:1.0:1788863757.287467:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:10536:x1875759298825728:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:1.0:1788863757.288047:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb2de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.288074:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb2de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.288089:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb2de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863757.288157:0:9496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788863757.288214:0:9496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e7ec34f reply state 000000003b69b2c7 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb2de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863757.288235:0:9496:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788863757.288388:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:10536:x1875759298825728:12345-192.168.204.51@tcp:36:bash.0 Request processed in 920us (1708us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788863757.288396:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 105 00000020:00080000:1.0:1788863757.288403:0:9496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788863757.291745:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb2de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.291773:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb2de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.291782:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb2de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.291790:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863757.291796:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb2de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.291830:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb2de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.291891:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:2.0:1788863757.291895:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863757.291902:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb2de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.291910:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbb2de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863757.293139:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863757.293481:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298825856 00000100:00100000:2.0:1788863757.293496:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298825856 00000100:00100000:2.0:1788863757.293584:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:2.0:1788863757.293596:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10536:x1875759298825856:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788863757.293652:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863757.293680:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb2e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330fce expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.293795:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.293815:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc7 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.293824:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.293904:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc7 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.293938:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc7 expref: 53 pid: 5841 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863757.293956:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6707:1875759324007168:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863757.294076:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bee4e0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788863757.297659:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863757.297802:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6707:1875759324007168:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863757.297839:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863757.298030:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298825984 00000100:00100000:1.0:1788863757.298041:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298825984 00010000:00010000:1.0:1788863757.298098:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc7 expref: 54 pid: 5841 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863757.298140:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:1.0:1788863757.298152:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:2350:x1875759298825984:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863757.298172:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863757.298181:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc7 expref: 54 pid: 5841 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.298195:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc7 expref: 54 pid: 5841 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.298223:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fc7 expref: 54 pid: 5841 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.298253:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:1.0:1788863757.298258:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.298291:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.298299:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.298348:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863757.298416:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:2350:x1875759298825984:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 265us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863757.298424:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00010000:00010000:2.0:1788863757.298491:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.298500:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863757.298563:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788863757.298568:0:6707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863757.298596:0:6707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.298652:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb2e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fce expref: 53 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.298672:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fce expref: 52 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.298680:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:2.0:1788863757.298691:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863757.298695:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554400, rc 0) 00000100:00100000:2.0:1788863757.298726:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10536:x1875759298825856:12345-192.168.204.51@tcp:101:bash.0 Request processed in 5133us (5602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863757.298734:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:3.0:1788863757.303205:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863757.303355:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298826240 00000100:00100000:2.0:1788863757.303372:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298826240 00000100:00100000:2.0:1788863757.303451:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:2.0:1788863757.303463:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:10536:x1875759298826240:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1788863757.303909:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:10536:x1875759298826240:12345-192.168.204.51@tcp:35:bash.0 Request processed in 447us (727us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788863757.303919:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1788863757.374307:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863757.375385:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298826368 00000100:00100000:1.0:1788863757.375402:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298826368 00000100:00100000:1.0:1788863757.375503:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 107 00000100:00100000:1.0:1788863757.375518:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:10542:x1875759298826368:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863757.375562:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863757.375599:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330fd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.375722:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb2fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.375741:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb2fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.375755:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb2fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863757.375807:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788863757.375816:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788863757.376114:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb2fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.376180:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7aa00/0x744cd7666bbbb2f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fd5 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.376205:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb2fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fd5 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.376216:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:1.0:1788863757.376219:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863757.376237:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b400, rc 0) 00000100:00100000:1.0:1788863757.376344:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:10542:x1875759298826368:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 829us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863757.376354:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 107 00000100:00100000:1.0:1788863757.379183:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863757.379282:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298826496 00000100:00100000:3.0:1788863757.379299:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298826496 00000100:00100000:3.0:1788863757.379441:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:3.0:1788863757.379454:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:10542:x1875759298826496:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788863757.379519:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863757.379683:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb301 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330fdc expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.379993:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb308 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380012:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb308 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380025:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb308 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380041:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb30f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380199:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb30f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380209:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb30f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380419:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb316 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380430:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380437:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863757.380491:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788863757.380507:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863757.380541:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380567:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380584:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb308 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380591:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb308 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380600:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb308 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380607:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863757.380612:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb308 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380621:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb308 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380634:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:3.0:1788863757.380636:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863757.380640:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb308 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380645:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb308 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380656:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb30f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380668:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb30f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380672:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb30f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380674:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863757.380676:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb30f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380680:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb30f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380684:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bc3015800) 00010000:00010000:3.0:1788863757.380685:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863757.380687:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb30f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380690:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb30f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380726:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb301 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fdc expref: 56 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380739:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fdc expref: 55 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.380752:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:3.0:1788863757.380754:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863757.380761:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17000, rc 0) 00000100:00100000:3.0:1788863757.380846:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:10542:x1875759298826496:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1396us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863757.380877:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:3.0:1788863757.388359:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863757.388419:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863757.388580:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298826752 00000100:00100000:2.0:1788863757.388598:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298826752 00000100:00100000:0.0:1788863757.388618:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298826880 00000100:00100000:0.0:1788863757.388635:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298826880 00000100:00100000:0.0:1788863757.388700:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1788863757.388713:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:2351:x1875759298826880:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863757.388740:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788863757.388768:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 109 00000100:00100000:2.0:1788863757.388780:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:10542:x1875759298826752:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863757.388790:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb316 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fdc expref: 56 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.388809:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863757.388820:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:0.0:1788863757.388827:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863757.388834:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb31d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330fe3 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.389025:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.389043:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fce expref: 56 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.389052:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.389123:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fce expref: 56 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.389141:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fce expref: 56 pid: 6707 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863757.389154:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:2351:x1875759298826880:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 442us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863757.389159:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6707:1875759324007296:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863757.389176:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1788863757.389272:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bee4e0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863757.394489:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6707:1875759324007296:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863757.394545:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863757.394665:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863757.395425:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298827008 00000100:00100000:2.0:1788863757.395439:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298827008 00010000:00010000:2.0:1788863757.395500:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fce expref: 56 pid: 6707 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863757.395561:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:2.0:1788863757.395575:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc66f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:2350:x1875759298827008:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863757.395603:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863757.395613:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fce expref: 56 pid: 6707 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.395628:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fce expref: 56 pid: 6707 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.395689:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb2ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fce expref: 56 pid: 6707 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.395709:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:2.0:1788863757.395714:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.395726:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.396894:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.396956:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863757.397056:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc66f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:2350:x1875759298827008:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1479us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863757.397066:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00010000:00010000:1.0:1788863757.397217:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.397237:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863757.397266:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788863757.397513:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb31d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fe3 expref: 57 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.397540:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fe3 expref: 56 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.397549:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:1.0:1788863757.397566:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788863757.397569:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554600, rc 0) 00000100:00100000:1.0:1788863757.397602:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:10542:x1875759298826752:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 8826us (9263us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788863757.397610:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 109 00000100:00100000:0.0:1788863757.398103:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863757.398127:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324007424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863757.398193:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863757.398268:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324007424 00000100:00100000:0.0:1788863757.398279:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324007424 00000100:00100000:0.0:1788863757.398342:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788863757.398353:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875759324007424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788863757.398399:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863757.398441:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875759324007424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863757.398447:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788863757.398467:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863757.398511:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324007424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863757.402168:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759324007808:0@lo:400:kworker.0 00000100:00100000:2.0:1788863757.402291:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863757.402347:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863757.402354:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324007680:0@lo:400:kworker.0 00000100:00100000:2.0:1788863757.402376:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863757.402409:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759324007936:0@lo:400:kworker.0 00000100:00100000:2.0:1788863757.402435:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863757.402453:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863757.402458:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324007552:0@lo:400:kworker.0 00000100:00100000:2.0:1788863757.402506:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863757.402560:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324007552 00000100:00100000:2.0:1788863757.402571:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324007552 00000100:00100000:3.0:1788863757.403990:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324007808 00000100:00100000:3.0:1788863757.404009:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324007808 00000100:00100000:3.0:1788863757.404108:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324007680 00000100:00100000:3.0:1788863757.404113:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324007680 00000100:00100000:3.0:1788863757.404136:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324007936 00000100:00100000:3.0:1788863757.404140:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324007936 00000100:00100000:3.0:1788863757.404167:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788863757.404179:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759324007808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863757.404317:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759324007808:12345-0@lo:400:kworker.0 Request processed in 140us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863757.404326:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788863757.404350:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788863757.404355:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324007680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863757.404385:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324007680:12345-0@lo:400:kworker.0 Request processed in 31us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863757.404391:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788863757.404402:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788863757.404407:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759324007936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863757.404440:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759324007936:12345-0@lo:400:kworker.0 Request processed in 34us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863757.404446:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1788863757.404825:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863757.405002:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324007680:0@lo:400:kworker.0 00000100:00100000:0.0:1788863757.405019:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759324007808:0@lo:400:kworker.0 00000100:00100000:2.0:1788863757.405198:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788863757.405212:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759324007552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863757.405276:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759324007552:12345-0@lo:400:kworker.0 Request processed in 70us (2769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863757.405283:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788863757.405331:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324007552:0@lo:400:kworker.0 00000100:00100000:2.0:1788863757.405344:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759324007936:0@lo:400:kworker.0 00000100:00100000:1.0:1788863757.406317:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863757.409564:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298827264 00000100:00100000:3.0:1788863757.409591:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298827264 00000100:00100000:3.0:1788863757.409721:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1788863757.409735:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:10542:x1875759298827264:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:3.0:1788863757.409759:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863757.409797:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb283 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fb9 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.409826:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:3.0:1788863757.409834:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863757.409977:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:10542:x1875759298827264:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 245us (3666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863757.409987:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1788863757.413830:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863757.413985:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298827392 00000100:00100000:1.0:1788863757.413999:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298827392 00000100:00100000:1.0:1788863757.414081:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:1.0:1788863757.414094:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:10542:x1875759298827392:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:1.0:1788863757.414317:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb332 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.414344:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb332 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863757.414360:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb332 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863757.415148:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788863757.415359:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:10542:x1875759298827392:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 1262us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863757.415371:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:1.0:1788863757.419671:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863757.419909:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298827520 00000100:00100000:2.0:1788863757.419929:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298827520 00000100:00100000:2.0:1788863757.420032:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:2.0:1788863757.420046:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:10542:x1875759298827520:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863757.420080:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863757.420112:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb339 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330fea expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.420220:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb332 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.420246:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb339 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fea expref: 55 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.420275:0:6707:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb332 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.420323:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb339 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fea expref: 55 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.420349:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:2.0:1788863757.420354:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863757.420359:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb339 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fea expref: 55 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863757.420369:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554400, rc 0) 00000100:00100000:2.0:1788863757.420477:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:10542:x1875759298827520:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 433us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863757.420486:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 111 00000040:00080000:0.0:1788863757.974417:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863757.974435:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863757.974543:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788863757.974554:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788863757.974769:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875759324008064:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788863757.975013:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc9376e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863757.985416:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875759324008064:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788863757.987359:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863757.988554:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298827648 00000100:00100000:0.0:1788863757.988573:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298827648 00000100:00100000:0.0:1788863757.988744:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:0.0:1788863757.988757:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:10543:x1875759298827648:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788863757.988811:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788863757.989021:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:10543:x1875759298827648:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 265us (1678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863757.989030:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:1.0:1788863757.994439:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863757.994553:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298827776 00000100:00100000:3.0:1788863757.994632:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298827776 00000100:00100000:3.0:1788863757.994713:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:3.0:1788863757.994725:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:10543:x1875759298827776:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788863757.994836:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb340 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.994907:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb340 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.994926:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb340 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.995723:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb347 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.995755:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb347 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.995765:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb347 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.995800:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb34e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.995811:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb34e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.995817:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb34e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863757.995920:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788863757.995927:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863757.996731:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb34e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.996754:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb340 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.996763:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb340 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.996772:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb340 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.996779:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863757.996784:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb340 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.996811:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb340 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.996831:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bcb0f5900) 00010000:00010000:3.0:1788863757.996834:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863757.996841:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb340 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.996887:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb340 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.996911:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb347 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.996918:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb347 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.996925:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb347 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.997584:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863757.997591:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb347 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.997601:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb347 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.997615:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8e8bc3015800) 00010000:00010000:3.0:1788863757.997619:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863757.997623:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb347 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.997649:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb347 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.997678:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb34e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.997685:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb34e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.997692:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb34e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.997698:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863757.997702:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb34e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.997708:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb34e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.997717:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:3.0:1788863757.997720:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863757.997723:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb34e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863757.997729:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb34e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863757.997908:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:10543:x1875759298827776:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 3179us (3483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863757.997919:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:1.0:1788863758.005949:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863758.006164:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298828032 00000100:00100000:2.0:1788863758.006181:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298828032 00000100:00080000:0.0:1788863758.006257:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863758.006298:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:2.0:1788863758.006314:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:10543:x1875759298828032:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863758.006351:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863758.006387:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb355 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ff1 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.006567:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb35c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.006586:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb35c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.007830:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb35c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863758.007894:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788863758.008086:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb35c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.008096:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb35c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.008106:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb35c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.008114:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863758.008120:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb35c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.008131:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb35c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.008149:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:2.0:1788863758.008153:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788863758.008160:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb35c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.008173:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb35c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.008764:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb355 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ff1 expref: 57 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.008782:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bcb0f5900) 00010000:00010000:2.0:1788863758.008785:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863758.008808:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb355 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ff1 expref: 57 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.008823:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555800, rc 0) 00000100:00100000:2.0:1788863758.009554:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:10543:x1875759298828032:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3237us (3616us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788863758.009567:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:0.0:1788863758.016685:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863758.017030:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298828160 00000100:00100000:2.0:1788863758.017046:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298828160 00000100:00100000:2.0:1788863758.017126:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:2.0:1788863758.017149:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:10543:x1875759298828160:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788863758.017224:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788863758.017394:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:10543:x1875759298828160:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 248us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863758.017405:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:1.0:1788863758.024017:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863758.024245:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298828416 00000100:00100000:3.0:1788863758.024261:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298828416 00000100:00100000:3.0:1788863758.024425:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:3.0:1788863758.024439:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:10543:x1875759298828416:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863758.024472:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863758.024476:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788863758.024520:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb2fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fd5 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.024547:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:3.0:1788863758.024554:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863758.024586:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb36a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330ff8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788863758.025416:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788863758.025712:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb371 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.025734:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.025751:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.025833:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb36a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ff8 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.025924:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb371 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ff8 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.025954:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bc3015800) 00010000:00010000:3.0:1788863758.025958:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863758.025961:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17600, rc 0) 00000100:00100000:3.0:1788863758.030345:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:10543:x1875759298828416:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1641us (2083us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788863758.030379:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:1.0:1788863758.030536:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863758.031187:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298828672 00000100:00100000:2.0:1788863758.031202:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298828672 00000100:00100000:2.0:1788863758.031322:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:2.0:1788863758.031336:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:10543:x1875759298828672:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788863758.031422:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863758.031464:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb371 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330ff8 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031491:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bc3015800) 00010000:00010000:2.0:1788863758.031504:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863758.031534:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb37f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031587:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb37f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031612:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb37f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031634:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xacd1503a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031642:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xacd1503a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031650:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xacd1503a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031766:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb37f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031775:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb37f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031783:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb37f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031790:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863758.031796:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb37f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031804:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb37f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031814:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863758.031833:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863758.031839:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb37f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031846:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb37f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031895:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xacd1503a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031901:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb386 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xacd1503a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031907:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xacd1503a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031913:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863758.031916:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xacd1503a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031922:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb386 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xacd1503a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031931:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xacd1503a (ffff8e8bc9330900) 00010000:00010000:2.0:1788863758.031934:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863758.031937:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb386 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xacd1503a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.031943:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb386 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xacd1503a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863758.032093:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:10543:x1875759298828672:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 758us (1556us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863758.032110:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:2.0:1788863758.036601:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.037292:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298828800 00000100:00100000:0.0:1788863758.037311:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298828800 00000100:00100000:0.0:1788863758.037404:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:0.0:1788863758.037420:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:10543:x1875759298828800:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863758.037454:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863758.037493:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbb38d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd330fff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.037546:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb394 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.037565:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.037580:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.038396:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166bc00/0x744cd7666bbbb38d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fff expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.038440:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fff expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.038452:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863758.038455:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863758.038460:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc166a400, rc 0) 00000100:00100000:0.0:1788863758.038578:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:10543:x1875759298828800:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1161us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863758.038588:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:1.0:1788863758.044518:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863758.044750:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298829056 00000100:00100000:3.0:1788863758.044765:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298829056 00000100:00100000:3.0:1788863758.044893:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:3.0:1788863758.045060:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:10543:x1875759298829056:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788863758.045179:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb39b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.045200:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb39b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.045226:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb39b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788863758.045535:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1788863758.045545:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387174692552ns, next at 388174689644ns, rc = 0 00000004:00010000:3.0:1788863758.046445:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fabd687c reply state 0000000099193409 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb39b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863758.046466:0:5841:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863758.046767:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:10543:x1875759298829056:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1860us (2264us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788863758.046796:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:1.0:1788863758.054549:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863758.055164:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298829184 00000100:00100000:3.0:1788863758.055182:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298829184 00000100:00100000:3.0:1788863758.055287:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:3.0:1788863758.055301:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:10543:x1875759298829184:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863758.055336:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863758.055367:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb3a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331006 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.055461:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb3a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331006 expref: 60 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.055482:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb3a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331006 expref: 60 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.055510:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:3.0:1788863758.055514:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788863758.055519:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16e00, rc 0) 00000100:00100000:3.0:1788863758.055681:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:10543:x1875759298829184:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 381us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863758.055689:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 120 00010000:00010000:2.0:1788863758.058360:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb39b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.058462:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb39b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.058473:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb39b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.058482:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863758.058489:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb39b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.058500:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb39b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.058525:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863758.058529:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788863758.058534:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb39b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.058542:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb39b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863758.059350:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.059424:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298829312 00000100:00100000:0.0:1788863758.059452:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298829312 00000100:00080000:1.0:1788863758.059551:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863758.059560:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:0.0:1788863758.059576:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf441c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298829312:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788863758.062645:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf441c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2350:x1875759298829312:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 3056us (3289us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788863758.062666:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:1.0:1788863758.065790:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863758.066012:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298829568 00000100:00100000:2.0:1788863758.066027:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298829568 00000100:00100000:2.0:1788863758.066130:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:2.0:1788863758.066144:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:10543:x1875759298829568:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788863758.068765:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:10543:x1875759298829568:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 2605us (2975us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788863758.068782:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:1.0:1788863758.075436:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.076311:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298829824 00000100:00100000:0.0:1788863758.076332:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298829824 00000100:00100000:0.0:1788863758.076428:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:0.0:1788863758.076576:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:10543:x1875759298829824:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788863758.076795:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:10543:x1875759298829824:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 355us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863758.076804:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:0.0:1788863758.089064:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863758.093885:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298829952 00000100:00100000:3.0:1788863758.093908:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298829952 00000100:00100000:3.0:1788863758.094092:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:3.0:1788863758.094107:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:10543:x1875759298829952:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863758.094139:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863758.094189:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33100d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.095495:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb3b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.095526:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.095544:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863758.095751:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863758.095781:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.095830:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33100d expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.096324:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33100d expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.096340:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:3.0:1788863758.096343:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788863758.096350:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17a00, rc 0) 00000100:00100000:3.0:1788863758.096482:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:10543:x1875759298829952:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2376us (7434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863758.096494:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:1.0:1788863758.101692:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863758.101944:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298830080 00000100:00100000:2.0:1788863758.101958:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298830080 00000100:00100000:2.0:1788863758.102243:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:2.0:1788863758.102256:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2351:x1875759298830080:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863758.102281:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863758.102311:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009edb1555/0x744cd7666bbbb3b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331014 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863758.102349:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe50d, blocks: 0x1 00010000:00010000:2.0:1788863758.102375:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1788863758.102380:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863758.102391:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009edb1555/0x744cd7666bbbb3b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331014 expref: 10 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.102415:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009edb1555/0x744cd7666bbbb3b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331014 expref: 10 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.102431:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554e00, rc 0) 00000100:00100000:2.0:1788863758.102768:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:2351:x1875759298830080:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 512us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863758.102777:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:1.0:1788863758.105485:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863758.106051:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298830336 00000100:00100000:3.0:1788863758.106066:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298830336 00000100:00100000:0.0:1788863758.106368:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:0.0:1788863758.106380:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:10543:x1875759298830336:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788863758.106713:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:10543:x1875759298830336:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 333us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863758.106722:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:3.0:1788863758.110954:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.111042:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298830464 00000100:00100000:0.0:1788863758.111058:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298830464 00000100:00100000:0.0:1788863758.111139:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1788863758.111152:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:10543:x1875759298830464:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863758.111178:0:10277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863758.111227:0:10277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33101b expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.111284:0:10277:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009edb1555/0x744cd7666bbbb3b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331014 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.111297:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863758.111302:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863758.111308:0:10277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33101b expref: 11 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.111363:0:10277:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009edb1555/0x744cd7666bbbb3b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331014 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.111381:0:10277:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009edb1555/0x744cd7666bbbb3b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331014 expref: 11 pid: 6680 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863758.111425:0:10277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10277:1875759324008192:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863758.111573:0:10277:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc9376000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863758.116340:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.116401:0:10277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10277:1875759324008192:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863758.116467:0:10277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33101b expref: 11 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.116501:0:10277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bc166bc00, rc 0) 00000100:00100000:2.0:1788863758.116526:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298830592 00000100:00100000:2.0:1788863758.116547:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298830592 00000100:00100000:0.0:1788863758.116591:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+12:10543:x1875759298830464:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 5440us (5651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863758.116604:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00010000:00010000:2.0:1788863758.116609:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009edb1555/0x744cd7666bbbb3b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331014 expref: 12 pid: 6680 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863758.116670:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:2.0:1788863758.116680:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+11:2350:x1875759298830592:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863758.116698:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863758.116732:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009edb1555/0x744cd7666bbbb3b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331014 expref: 11 pid: 6680 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.116747:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009edb1555/0x744cd7666bbbb3b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331014 expref: 11 pid: 6680 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.116780:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009edb1555/0x744cd7666bbbb3b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331014 expref: 11 pid: 6680 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.116797:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863758.116802:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863758.116812:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33101b expref: 10 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.116824:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33101b expref: 10 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.116936:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33101b expref: 10 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863758.116971:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23c9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1875759324008320:192.168.204.51@tcp:105: 00000100:00100000:2.0:1788863758.117049:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bee4e0900 going to sleep for 11 seconds 00000100:00100000:2.0:1788863758.121595:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23c9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1875759324008320:192.168.204.51@tcp:105: 00010000:00010000:2.0:1788863758.121653:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863758.121733:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:2350:x1875759298830592:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 5052us (5408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863758.121748:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:3.0:1788863758.130521:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863758.130771:0:6684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298830720 00000100:00100000:2.0:1788863758.130788:0:6684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298830720 00002000:00100000:2.0:1788863758.130896:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e8bff1e5f80 x1875759298830720/t0(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:744/0 lens 504/0 e 0 to 0 dl 1788863769 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863758.130909:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bff1e5f80 with x1875759298830720 ext(0->12) 00002000:00010000:2.0:1788863758.130916:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bff1e5f80 00000100:00100000:2.0:1788863758.130953:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:2.0:1788863758.130964:0:6684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:2351:x1875759298830720:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788863758.131690:0:6684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+12:2351:x1875759298830720:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 721us (1181us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788863758.131699:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00002000:00100000:2.0:1788863758.131708:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e8bff1e5f80 x1875759298830720/t4294967308(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:744/0 lens 504/448 e 0 to 0 dl 1788863769 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863758.131717:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bff1e5f80 with x1875759298830720 ext(0->12) 00002000:00010000:2.0:1788863758.131723:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bff1e5f80 00000100:00100000:1.0:1788863758.139921:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.140524:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298830848 00000100:00100000:0.0:1788863758.140540:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298830848 00000100:00100000:0.0:1788863758.140633:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:0.0:1788863758.140648:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:10543:x1875759298830848:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788863758.208917:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967376 is committed 00000001:00080000:2.0:1788863758.209056:0:11974:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000020:00080000:2.0:1788863758.209089:0:11974:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8be1ed4780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788863758.209096:0:11974:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bd2933600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8be1ed4240 00000020:00080000:2.0:1788863758.209099:0:11974:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bd2933700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bff13d000 00000020:00080000:1.0:1788863758.209148:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 0 00000020:00080000:1.0:1788863758.209461:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000001:00080000:3.0:1788863758.210161:0:11975:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788863758.210202:0:11975:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788863758.210283:0:11975:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1788863758.210568:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:10543:x1875759298830848:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 69905us (70646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863758.210582:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 124 00000004:00080000:3.0:1788863758.210679:0:11973:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788863758.214073:0:11973:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1788863758.215081:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324008448:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788863758.215184:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863758.215341:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324008448 00000100:00100000:0.0:1788863758.215353:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324008448 00000100:00100000:0.0:1788863758.215421:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000020:00080000:3.0:1788863758.215424:0:11973:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8bff235a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788863758.215431:0:11973:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bff6e2d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bff235480 00000100:00100000:0.0:1788863758.215435:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875759324008448:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1788863758.215437:0:11973:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bff74ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bee549000 00002000:00080000:0.0:1788863758.215476:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788863758.215539:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.215582:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003217867a/0x744cd7666bbbb187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f7a expref: 11 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.215592:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788863758.215597:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863758.215602:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.215636:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003217867a/0x744cd7666bbbb187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f7a expref: 11 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.215652:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003217867a/0x744cd7666bbbb187 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f7a expref: 11 pid: 10277 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863758.215665:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1875759324008576:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863758.215747:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ed3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863758.215972:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863758.215983:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324008704:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788863758.216021:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863758.216052:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324008704 00000100:00100000:0.0:1788863758.216056:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324008704 00000100:00100000:0.0:1788863758.216083:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788863758.216090:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1875759324008704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788863758.216105:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1788863758.216137:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9fe50b, atime: 0x6a9fe50c, ctime: 0x6a9fe50b, blocks: 0x1 00010000:00010000:0.0:1788863758.216152:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbb3cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.216163:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=387s v=(0 0) 00010000:00010000:0.0:1788863758.216167:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863758.216173:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbb3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.216194:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbb3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.216206:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbb3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.216224:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbb3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.216244:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788863758.216831:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863758.216986:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863758.217003:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324008832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788863758.217038:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863758.217076:0:6680:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788863758.217085:0:6680:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000020:00080000:1.0:1788863758.217197:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788863758.217304:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788863758.217333:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298830976 00000100:00100000:1.0:1788863758.217340:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298830976 00000100:00100000:1.0:1788863758.217371:0:6680:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788863758.217376:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324008832 00000100:00100000:1.0:1788863758.217378:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324008832 00000100:00100000:1.0:1788863758.217466:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:1.0:1788863758.217476:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+12:2353:x1875759298830976:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788863758.221129:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3309:x1875759324008704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5026us (5094us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788863758.221148:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788863758.221197:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788863758.221223:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875759324008832:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788863758.221441:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863758.221452:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbb3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.221484:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863758.221489:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbb3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.221502:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbb3cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.221533:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbb3cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.221540:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbb3cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788863758.222736:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8bedc8e680/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788863758.222753:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324008704:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788863758.224248:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863758.224256:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863758.224259:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863758.224312:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1875759324008576:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863758.224358:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863758.224509:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.224968:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298831104 00000100:00100000:0.0:1788863758.224979:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298831104 00010000:00010000:0.0:1788863758.225023:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003217867a/0x744cd7666bbbb187 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f7a expref: 13 pid: 10277 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863758.225903:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:0.0:1788863758.225921:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:2351:x1875759298831104:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863758.225943:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863758.225953:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003217867a/0x744cd7666bbbb187 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f7a expref: 13 pid: 10277 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.225970:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003217867a/0x744cd7666bbbb187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f7a expref: 13 pid: 10277 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.226001:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003217867a/0x744cd7666bbbb187 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f7a expref: 13 pid: 10277 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.226022:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863758.226026:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863758.226033:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.226043:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.226073:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863758.226156:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+12:2351:x1875759298831104:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 241us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863758.226164:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00002000:00010000:1.0:1788863758.226264:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788863758.226269:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788863757 00002000:00010000:1.0:1788863758.226271:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788863758.226273:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788863757 -> 1788863757 00002000:00010000:1.0:1788863758.226283:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788863758.226355:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3308:x1875759324008832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5148us (9313us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788863758.226364:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000004:00080000:1.0:1788863758.226555:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8bff0bb100/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788863758.226564:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324008832:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788863758.226988:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.227001:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.227015:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.227024:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.227050:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788863758.231666:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3307:x1875759324008448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15104us (15352us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788863758.231704:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1788863758.232435:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863758.232450:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.232466:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863758.232492:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.232505:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.232532:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.232540:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000078ab281/0x744cd7666bbbb3c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.232647:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863758.232650:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863758.232652:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788863758.234053:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8bff0b8380/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788863758.234070:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324008448:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788863758.279260:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1788863758.279298:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1788863758.279311:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1788863758.279458:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298830976:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 61973us (62619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863758.279473:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:2.0:1788863758.287152:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863758.287315:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298831360 00000100:00100000:3.0:1788863758.287331:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298831360 00000100:00100000:3.0:1788863758.289945:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:3.0:1788863758.289980:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:10543:x1875759298831360:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788863758.290061:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863758.290099:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb3b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33100d expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.290127:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:3.0:1788863758.290134:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863758.290178:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.290195:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863758.290238:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863758.293489:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da6aefb3 reply state 00000000c107561b transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863758.293525:0:5841:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863758.293767:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:10543:x1875759298831360:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 3799us (6627us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788863758.293779:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:3.0:1788863758.297641:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863758.297839:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298831488 00000100:00100000:1.0:1788863758.297887:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298831488 00000100:00100000:1.0:1788863758.297969:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:1.0:1788863758.297982:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298831488:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788863758.298274:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788863758.298280:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788863757 -> 1788863756 00002000:00010000:1.0:1788863758.298302:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788863756 00002000:00010000:1.0:1788863758.298304:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788863757 -> 1788863756 00002000:00010000:1.0:1788863758.298307:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788863758.298395:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298831488:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 415us (772us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788863758.298404:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00010000:00010000:2.0:1788863758.298974:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.298991:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.299000:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.299007:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863758.299013:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.299024:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.299062:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863758.299066:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863758.299072:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.299080:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb3d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.302343:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863758.311764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.312027:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298831744 00000100:00100000:0.0:1788863758.312043:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298831744 00000100:00100000:0.0:1788863758.312186:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:0.0:1788863758.312202:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:10543:x1875759298831744:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788863758.312588:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.312612:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb394 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fff expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.312621:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.312677:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fff expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.312694:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb394 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fff expref: 15 pid: 5840 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863758.312713:0:9496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9496:1875759324008960:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863758.312848:0:9496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1788863758.318167:0:9496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9496:1875759324008960:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863758.318236:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863758.320711:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863758.320909:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298831872 00000100:00100000:2.0:1788863758.320926:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298831872 00010000:00010000:2.0:1788863758.320982:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb394 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fff expref: 16 pid: 5840 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863758.321043:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:2.0:1788863758.321055:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:2350:x1875759298831872:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863758.321089:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863758.321098:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb394 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fff expref: 16 pid: 5840 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.321114:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fff expref: 16 pid: 5840 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.321144:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc166a400/0x744cd7666bbbb394 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fff expref: 16 pid: 5840 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.321166:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863758.321172:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.321215:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.321225:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.321264:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863758.321334:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:2350:x1875759298831872:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 280us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863758.321342:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00010000:00010000:1.0:1788863758.321908:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.321921:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.321959:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.321966:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.321973:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.321979:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863758.321984:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.321993:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.322022:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:1.0:1788863758.322025:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788863758.322030:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.322038:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb3da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863758.322186:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:10543:x1875759298831744:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 9985us (10435us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788863758.322196:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:1.0:1788863758.327914:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.328068:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298832000 00000100:00100000:0.0:1788863758.328103:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298832000 00000100:00100000:0.0:1788863758.328178:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:0.0:1788863758.328191:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298832000:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788863758.328271:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.328301:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33101b expref: 7 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.328311:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863758.328315:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863758.328320:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.328373:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33101b expref: 7 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.328391:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33101b expref: 7 pid: 10277 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863758.328410:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6679:1875759324009088:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863758.328522:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1788863758.333117:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6679:1875759324009088:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863758.333160:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863758.335619:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863758.336523:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298832128 00000100:00100000:2.0:1788863758.336542:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298832128 00010000:00010000:2.0:1788863758.336620:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33101b expref: 8 pid: 10277 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863758.336681:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:2.0:1788863758.336692:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2351:x1875759298832128:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863758.336710:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863758.336752:0:8500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33101b expref: 8 pid: 10277 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.336769:0:8500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33101b expref: 8 pid: 10277 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.336987:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021bb2ed1/0x744cd7666bbbb3be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33101b expref: 8 pid: 10277 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.337041:0:8500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863758.337046:0:8500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863758.337054:0:8500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.337066:0:8500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.337646:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863758.338068:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298832128:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1371us (2458us total) trans 0 rc 0/0 00010000:00010000:0.0:1788863758.338192:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.338215:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.338255:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.338265:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.338273:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.338281:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b600 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863758.338286:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.338296:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.338317:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.338354:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5d27543/0x744cd7666bbbb3e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863758.338437:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298832000:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 10249us (10539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863758.338449:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:2.0:1788863758.339961:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:2.0:1788863758.343832:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.344067:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298832384 00000100:00100000:0.0:1788863758.344095:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298832384 00000100:00100000:0.0:1788863758.344164:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:0.0:1788863758.344177:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:10543:x1875759298832384:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788863758.344305:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb3e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.344331:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.344346:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.344675:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.344693:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb3a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331006 expref: 15 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.344702:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.344769:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb3a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331006 expref: 15 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.344792:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb3a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331006 expref: 15 pid: 6707 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863758.344811:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875759324009216:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863758.344984:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33ed300 going to sleep for 11 seconds 00000100:00100000:1.0:1788863758.354455:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863758.354571:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298832512 00000100:00100000:2.0:1788863758.354585:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298832512 00010000:00010000:2.0:1788863758.354645:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb3a2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331006 expref: 16 pid: 6707 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863758.354752:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:2.0:1788863758.354765:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:2350:x1875759298832512:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863758.354796:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863758.354805:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb3a2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331006 expref: 16 pid: 6707 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.354834:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb3a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331006 expref: 16 pid: 6707 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.354928:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863758.354935:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.354947:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.354956:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.354982:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863758.355064:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+16:2350:x1875759298832512:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 302us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863758.355073:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00010000:00010000:0.0:1788863758.355166:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb3a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331006 expref: 15 pid: 6707 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863758.355187:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875759324009216:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863758.355229:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.355240:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.355246:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863758.355521:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788863758.355702:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788863758.355754:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788863758.355915:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1875759324009344:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788863758.355985:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863758.356020:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc8a30000 going to sleep for 11 seconds 00000100:00100000:3.0:1788863758.356111:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324009344 00000100:00100000:3.0:1788863758.356122:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324009344 00000100:00100000:3.0:1788863758.356180:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788863758.356190:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5840:x1875759324009344:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788863758.356333:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5840:x1875759324009344:12345-0@lo:1000:mdt00_000.0 Request processed in 133us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863758.356336:0:5840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000100:00100000:3.0:1788863758.356342:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788863758.356343:0:5840:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:0.0:1788863758.356373:0:5840:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e8bff0bb100 x1875759324008832/t4294967309(4294967309) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788863774 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863758.356388:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1875759324009344:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788863758.357006:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788863758.357095:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1875759324009472:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788863758.357144:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863758.357170:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc8a30b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863758.357271:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324009472 00000100:00100000:3.0:1788863758.357280:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324009472 00000100:00100000:3.0:1788863758.357334:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788863758.357343:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5840:x1875759324009472:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788863758.357566:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5840:x1875759324009472:12345-0@lo:1000:mdt00_000.0 Request processed in 224us (421us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788863758.357574:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863758.357590:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1875759324009472:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788863758.357627:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.357638:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.357647:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.357654:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18ac00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863758.357659:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.357669:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.357691:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863758.357694:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863758.357700:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.357981:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.358027:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb332 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.358034:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb332 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.358040:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb332 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.358046:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863758.358049:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb332 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.358056:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb332 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.358065:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:0.0:1788863758.358068:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863758.358076:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb339 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fea expref: 18 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.358089:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb339 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fea expref: 18 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.358099:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb339 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fea expref: 18 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.358149:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb339 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fea expref: 18 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863758.358165:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875759324009600:192.168.204.51@tcp:105: 00000100:00100000:0.0:1788863758.358386:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc8a30b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863758.365335:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875759324009600:192.168.204.51@tcp:105: 00010000:00010000:0.0:1788863758.365383:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb332 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365396:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb332 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365450:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb3f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365468:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb3f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365482:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb3f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365496:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb3f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365502:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb3f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365509:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb3f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365547:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863758.365661:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb3f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365670:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb3f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365686:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:0.0:1788863758.365689:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863758.365693:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb3f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365699:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb3f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365710:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.365716:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb3e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.366082:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb3e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.366089:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18bc00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863758.366093:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb3e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.366100:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb3e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.366123:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:0.0:1788863758.366126:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863758.366129:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb3e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.366136:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb3e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863758.367039:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:10543:x1875759298832384:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 22852us (23215us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788863758.367054:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 127 00000020:00080000:0.0:1788863758.367063:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788863758.367683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.367949:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298832640 00000100:00100000:0.0:1788863758.367961:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298832640 00000100:00100000:0.0:1788863758.368049:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1788863758.368060:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:10542:x1875759298832640:12345-192.168.204.51@tcp:49:lfs.0 00000100:00100000:0.0:1788863758.368197:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:10542:x1875759298832640:12345-192.168.204.51@tcp:49:lfs.0 Request processed in 139us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863758.368216:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000040:00080000:3.0:1788863758.369015:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863758.369024:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863758.369517:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788863758.369528:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788863758.372442:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.372593:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298832896 00000100:00100000:0.0:1788863758.372608:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298832896 00000100:00100000:0.0:1788863758.372728:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:0.0:1788863758.372743:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc2e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:10543:x1875759298832896:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788863758.374398:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788863758.374533:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788863758.374626:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.374660:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.374678:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.374690:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.374698:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.374705:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.375277:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863758.375953:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863758.375964:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.375974:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18ac00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863758.375979:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.375989:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.376007:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863758.376011:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788863758.376016:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3fd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.376034:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb3fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.376058:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863758.376060:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863758.376062:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863758.376092:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc2e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:10543:x1875759298832896:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 3345us (3658us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788863758.376105:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000020:00080000:0.0:1788863758.376113:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788863758.376762:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863758.376885:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298833152 00000100:00100000:3.0:1788863758.376900:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298833152 00000100:00100000:3.0:1788863758.377006:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:3.0:1788863758.377017:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:10542:x1875759298833152:12345-192.168.204.51@tcp:58:lfs.0 00000040:00080000:3.0:1788863758.377396:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788863758.377567:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:10542:x1875759298833152:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 549us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863758.377575:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:1.0:1788863758.415022:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.415141:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298833280 00000100:00100000:0.0:1788863758.415157:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298833280 00000100:00100000:0.0:1788863758.415256:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:0.0:1788863758.415271:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:10546:x1875759298833280:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863758.415307:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863758.415336:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331022 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.415430:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb40b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.415470:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb40b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.415487:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb40b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.415505:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.415513:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.415520:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.415978:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b800/0x744cd7666bbbb419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.415997:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fe3 expref: 21 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.416007:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b800/0x744cd7666bbbb419 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.416295:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fe3 expref: 21 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863758.416318:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fe3 expref: 21 pid: 6707 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863758.416337:0:9496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9496:1875759324009728:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863758.416457:0:9496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bee4e0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788863758.421317:0:9496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9496:1875759324009728:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863758.421368:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b800/0x744cd7666bbbb419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863758.430722:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863758.437180:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298833536 00000100:00100000:3.0:1788863758.437217:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298833536 00000100:00100000:3.0:1788863758.437294:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1788863758.437306:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+22:5592:x1875759298833536:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788863758.438536:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:5592:x1875759298833536:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 1224us (7820us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788863758.438550:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:2.0:1788863758.448784:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863758.448887:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298833664 00000100:00100000:0.0:1788863758.448903:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298833664 00010000:00010000:1.0:1788863758.449093:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fe3 expref: 23 pid: 6707 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863758.449144:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1788863758.449157:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc66f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:2352:x1875759298833664:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863758.449175:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863758.449199:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fe3 expref: 23 pid: 6707 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.449226:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fe3 expref: 23 pid: 6707 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.449253:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb324 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fe3 expref: 23 pid: 6707 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.449271:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:1.0:1788863758.449277:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b800/0x744cd7666bbbb419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.449287:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b800/0x744cd7666bbbb419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.449295:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b800/0x744cd7666bbbb419 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863758.449336:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863758.449403:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc66f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+22:2352:x1875759298833664:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 248us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863758.449411:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00010000:00010000:0.0:1788863758.450390:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b800/0x744cd7666bbbb419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450413:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b800/0x744cd7666bbbb419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863758.450499:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788863758.450504:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788863758.450531:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b800/0x744cd7666bbbb419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450547:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b800/0x744cd7666bbbb419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450569:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb40b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450576:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb40b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450583:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb40b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450589:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863758.450593:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb40b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450703:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb40b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450718:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:0.0:1788863758.450722:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863758.450727:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb40b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450734:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb40b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450764:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450770:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb412 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450777:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450783:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863758.450786:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450791:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb412 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450800:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8bcb0f5e00) 00010000:00010000:0.0:1788863758.450802:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863758.450805:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb412 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450811:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb412 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450897:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331022 expref: 22 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450913:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b800/0x744cd7666bbbb419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331022 expref: 21 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863758.450932:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:0.0:1788863758.450935:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863758.450937:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18b800, rc 0) 00000100:00100000:0.0:1788863758.451096:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:10546:x1875759298833280:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 35827us (36092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863758.451106:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 129 00000001:00080000:1.0:1788863758.475419:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788863758.475449:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788863759.185230:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863759.185295:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863759.185343:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863759.185383:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863759.185414:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863759.185461:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298834176 00000100:00100000:2.0:1788863759.185475:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298834176 00000100:00100000:3.0:1788863759.185493:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298833920 00000100:00100000:3.0:1788863759.185500:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298833920 00000100:00100000:2.0:1788863759.185549:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298834048 00000100:00100000:3.0:1788863759.185550:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298834304 00000100:00100000:2.0:1788863759.185555:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298834048 00000100:00100000:3.0:1788863759.185557:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298834304 00000100:00100000:1.0:1788863759.185720:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:1.0:1788863759.185736:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298834176:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863759.185872:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298834176:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 139us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863759.185903:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1788863759.185913:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298834048:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863759.185959:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298834048:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 48us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863759.185967:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1788863759.186003:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 145 00000100:00100000:2.0:1788863759.186018:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:2351:x1875759298833920:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863759.186019:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:2.0:1788863759.186059:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:2351:x1875759298833920:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 47us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863759.186066:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 145 00000100:00100000:0.0:1788863759.186145:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298833792 00000100:00100000:0.0:1788863759.186151:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298833792 00000100:00100000:0.0:1788863759.186206:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 290 00000100:00100000:0.0:1788863759.186215:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298833792:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863759.186246:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298833792:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863759.186253:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 290 00000100:00100000:3.0:1788863759.187669:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:3.0:1788863759.187690:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298834304:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:2.0:1788863759.187708:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863759.187717:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863759.187781:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298834304:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 97us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863759.187797:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 146 00010000:00010000:0.0:1788863759.320095:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863759.365516:0:12055:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863759.365528:0:12055:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863759.365580:0:12055:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788863759.365586:0:12055:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788863759.383235:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863759.383250:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863759.383467:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788863759.383477:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788863759.392515:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875759324009856:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788863759.392653:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bee4e0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788863759.402900:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875759324009856:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788863759.404237:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863759.404480:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298834432 00000100:00100000:1.0:1788863759.404498:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298834432 00000100:00100000:1.0:1788863759.404601:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:1.0:1788863759.404614:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:10557:x1875759298834432:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788863759.404661:0:9496:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788863759.406959:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:10557:x1875759298834432:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 2318us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863759.406982:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:1.0:1788863759.415220:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863759.415305:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298834688 00000100:00100000:0.0:1788863759.415320:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298834688 00000100:00100000:0.0:1788863759.415404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:0.0:1788863759.415418:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:10557:x1875759298834688:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863759.415449:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863759.415483:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb420 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331029 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.415967:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.415995:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.416376:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863759.416395:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788863759.416890:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb420 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331029 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.416912:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331029 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.416924:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:0.0:1788863759.416927:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863759.416932:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18b600, rc 0) 00000100:00100000:0.0:1788863759.417376:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:10557:x1875759298834688:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1957us (2172us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788863759.417386:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:3.0:1788863759.425338:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863759.425405:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863759.426009:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298834944 00000100:00100000:0.0:1788863759.426156:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298834944 00000100:00100000:0.0:1788863759.426250:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:0.0:1788863759.426264:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:10557:x1875759298834944:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788863759.426379:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb435 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.426411:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb435 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.426427:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb435 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.427316:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb435 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.427332:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb435 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.427341:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb435 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.427348:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863759.427354:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb435 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.427363:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb435 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.427381:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:0.0:1788863759.427384:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863759.427390:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb435 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863759.427396:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb435 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863759.427654:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:10557:x1875759298834944:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 1386us (2330us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788863759.427671:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:1.0:1788863759.428316:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298835072 00000040:00080000:3.0:1788863759.428587:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863759.428597:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863759.429931:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788863759.429954:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788863759.430143:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298835072 00000100:00100000:1.0:1788863759.430268:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788863759.430281:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:2352:x1875759298835072:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863759.430310:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863759.431619:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331029 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863759.431645:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:1.0:1788863759.431664:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863759.431745:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:2352:x1875759298835072:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1465us (6343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863759.431757:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788863759.443152:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863759.443802:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298835328 00000100:00100000:0.0:1788863759.443818:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298835328 00000100:00100000:0.0:1788863759.443919:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:0.0:1788863759.443935:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:10557:x1875759298835328:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788863759.444504:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:10557:x1875759298835328:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 571us (1364us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788863759.444513:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:3.0:1788863759.448909:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffdcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324009984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863759.449030:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863759.449259:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324009984 00000100:00100000:0.0:1788863759.449271:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324009984 00000100:00080000:2.0:1788863759.449328:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863759.449361:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788863759.449373:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324009984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863759.449424:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863759.449502:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324009984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863759.449511:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788863759.449615:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788863759.449623:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1788863759.449663:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8bff137b80, transno 4294967301 00000004:00080000:2.0:1788863759.449683:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788863759.449702:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8bedc8e680, transno 4294967304 00000100:00100000:2.0:1788863759.449718:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffdcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324009984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863760.342148:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863761.365993:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863761.366004:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863761.366052:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788863761.366059:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788863761.366913:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863761.647967:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863761.648057:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298835584 00000100:00100000:1.0:1788863761.648069:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298835584 00000100:00100000:1.0:1788863761.648155:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:1.0:1788863761.648166:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:10578:x1875759298835584:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863761.648194:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863761.648217:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb43c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331030 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863761.648332:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb443 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863761.648347:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb443 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863761.648360:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb443 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863761.648373:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788863761.648517:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb43c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331030 expref: 27 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863761.648537:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb443 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331030 expref: 26 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863761.648546:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:1.0:1788863761.648548:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788863761.648553:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7be00, rc 0) 00000100:00100000:1.0:1788863761.648628:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+26:10578:x1875759298835584:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 464us (680us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788863761.648653:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00080000:2.0:1788863761.651252:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863761.658371:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863761.658464:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298835712 00000100:00100000:0.0:1788863761.658477:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298835712 00000100:00100000:0.0:1788863761.658554:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:0.0:1788863761.658565:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+26:10578:x1875759298835712:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1788863761.658664:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb451 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863761.658691:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863761.658726:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863761.658756:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863761.658763:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb451 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863761.658771:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863761.658777:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863761.658782:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863761.658791:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb451 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863761.658804:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:0.0:1788863761.658807:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863761.658812:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb451 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863761.658819:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb451 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863761.658960:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+26:10578:x1875759298835712:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 395us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863761.659179:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:0.0:1788863761.786112:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863761.788477:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298835840 00000100:00100000:1.0:1788863761.788518:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298835840 00000100:00100000:1.0:1788863761.788645:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:1.0:1788863761.788657:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298835840:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:1.0:1788863761.789146:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863761.789174:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e2c281/0x744cd7666bbbb458 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331037 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788863761.789209:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9fe50c, atime: 0x6a9fe50c, ctime: 0x6a9fe50c, blocks: 0xb 00010000:00010000:1.0:1788863761.789239:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788863761.789246:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863761.789258:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e2c281/0x744cd7666bbbb458 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331037 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863761.789285:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029e2c281/0x744cd7666bbbb458 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331037 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863761.789302:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7aa00, rc 0) 00000100:00100000:1.0:1788863761.789412:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2350:x1875759298835840:12345-192.168.204.51@tcp:101:cat.0 Request processed in 754us (3307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863761.789422:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00080000:2.0:1788863761.790590:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863761.804099:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863761.804323:0:6683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298835968 00000100:00100000:0.0:1788863761.804339:0:6683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298835968 00002000:00100000:0.0:1788863761.804404:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8e8bff0bbb80 x1875759298835968/t0(0) o3->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:747/0 lens 488/0 e 0 to 0 dl 1788863772 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863761.804418:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bff0bbb80 with x1875759298835968 ext(0->4095) 00002000:00010000:0.0:1788863761.804426:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bff0bbb80 00000100:00100000:0.0:1788863761.804480:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1788863761.804600:0:6683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298835968:12345-192.168.204.51@tcp:3:cat.0 00000100:00100000:0.0:1788863761.804949:0:6683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298835968:12345-192.168.204.51@tcp:3:cat.0 Request processed in 355us (862us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788863761.804956:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00002000:00100000:0.0:1788863761.804963:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8e8bff0bbb80 x1875759298835968/t0(0) o3->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:747/0 lens 488/4536 e 0 to 0 dl 1788863772 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863761.804971:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bff0bbb80 with x1875759298835968 ext(0->4095) 00002000:00010000:0.0:1788863761.804974:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bff0bbb80 00010000:00010000:2.0:1788863762.390115:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863762.518222:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759324010112:0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.518305:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863762.518361:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324010624:0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.518387:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863762.518414:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863762.518420:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324010496:0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.518448:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863762.518495:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff07dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324010240:0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.518522:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863762.518551:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324010752:0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.518576:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863762.518596:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863762.518602:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324010368:0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.518622:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863762.518658:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324010112 00000100:00100000:0.0:1788863762.518669:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324010112 00000100:00100000:0.0:1788863762.518727:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788863762.518737:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759324010112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.518816:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759324010112:12345-0@lo:400:kworker.0 Request processed in 80us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863762.518824:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788863762.518876:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324010624 00000100:00100000:0.0:1788863762.518881:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324010624 00000100:00100000:0.0:1788863762.518915:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324010240 00000100:00100000:0.0:1788863762.518918:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324010240 00000100:00100000:0.0:1788863762.518937:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324010368 00000100:00100000:0.0:1788863762.518939:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324010368 00000100:00100000:0.0:1788863762.518957:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788863762.518963:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324010624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.518997:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324010624:12345-0@lo:400:kworker.0 Request processed in 33us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863762.519003:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788863762.519015:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788863762.519020:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324010240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.519052:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324010240:12345-0@lo:400:kworker.0 Request processed in 31us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863762.519065:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788863762.519078:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788863762.519083:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324010368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.519111:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324010368:12345-0@lo:400:kworker.0 Request processed in 28us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863762.519116:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788863762.519143:0:12016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324010496 00000100:00100000:0.0:1788863762.519147:0:12016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324010496 00000100:00100000:0.0:1788863762.519168:0:12016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324010752 00000100:00100000:0.0:1788863762.519171:0:12016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324010752 00000100:00100000:0.0:1788863762.519192:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788863762.519197:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324010496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.519228:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324010496:12345-0@lo:400:kworker.0 Request processed in 31us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863762.519234:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788863762.519245:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788863762.519251:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3308:x1875759324010752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.519274:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3308:x1875759324010752:12345-0@lo:400:kworker.0 Request processed in 24us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863762.519279:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788863762.519313:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863762.519318:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863762.519320:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863762.519368:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324010368:0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.519379:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff07dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324010240:0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.519389:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324010752:0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.519441:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324010496:0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.519449:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759324010112:0@lo:400:kworker.0 00000100:00100000:0.0:1788863762.519458:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324010624:0@lo:400:kworker.0 00000100:00100000:2.0:1788863762.520432:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863762.520449:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324010880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863762.520508:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863762.521110:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324010880 00000100:00100000:1.0:1788863762.521120:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324010880 00000100:00100000:1.0:1788863762.521205:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788863762.521214:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3308:x1875759324010880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863762.521267:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863762.521339:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3308:x1875759324010880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863762.521347:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788863762.521615:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324010880:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788863763.415118:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788863763.645390:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1788863763.645412:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1788863763.645418:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788863763.645424:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1788863763.648914:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1788863763.648959:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8bc8a30600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788863763.648966:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bedc9ca00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bc8a30000 00000020:00080000:2.0:1788863763.648970:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bedc9c900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bff757c00 00000001:00080000:3.0:1788863763.648990:0:11975:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1788863763.649004:0:11975:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788863763.649008:0:11975:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:1.0:1788863763.649011:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788863763.649297:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:1.0:1788863763.649708:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1788863764.284998:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863764.285047:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863764.285159:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298836096 00000100:00100000:0.0:1788863764.285176:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298836096 00000100:00100000:0.0:1788863764.285252:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 292 00000100:00100000:0.0:1788863764.285265:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298836096:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863764.285406:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298836096:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 143us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863764.285416:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 292 00000100:00100000:3.0:1788863764.288151:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863764.288191:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863764.288367:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863764.291182:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298836608 00000100:00100000:0.0:1788863764.291209:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298836608 00000100:00100000:0.0:1788863764.291307:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298836224 00000100:00100000:0.0:1788863764.291311:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298836224 00000100:00100000:0.0:1788863764.291347:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:0.0:1788863764.291363:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298836608:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863764.291586:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298836352 00000100:00100000:1.0:1788863764.291604:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298836352 00000100:00100000:3.0:1788863764.291771:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:3.0:1788863764.291798:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:2350:x1875759298836224:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863764.291936:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:2350:x1875759298836224:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 153us (3744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863764.291954:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00080000:3.0:1788863764.291989:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863764.292004:0:12016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298836480 00000100:00100000:3.0:1788863764.292008:0:12016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298836480 00000100:00100000:3.0:1788863764.292055:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:3.0:1788863764.293615:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298836480:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863764.293691:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298836480:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 97us (5323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863764.294631:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298836608:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 3256us (6476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863764.294651:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00080000:0.0:1788863764.300648:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863764.300663:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863764.300791:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:0.0:1788863764.300830:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298836352:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863764.300841:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:0.0:1788863764.301123:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298836352:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 312us (16072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863764.301134:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00010000:00010000:1.0:1788863764.454021:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863764.570050:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863764.570096:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324011008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863764.570226:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863764.570684:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324011008 00000100:00100000:1.0:1788863764.570698:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324011008 00000100:00100000:1.0:1788863764.570815:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788863764.570830:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324011008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863764.570924:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863764.570996:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324011008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863764.571005:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788863764.571188:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863764.571247:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324011008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788863765.469384:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863765.590958:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863765.590974:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863765.591027:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788863765.591035:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788863766.493486:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863767.510647:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863767.638373:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863767.638402:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324011136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863767.638479:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863767.638592:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324011136 00000100:00100000:1.0:1788863767.638600:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324011136 00000100:00100000:1.0:1788863767.638670:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788863767.638681:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324011136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863767.638740:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863767.638792:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324011136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863767.638800:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788863767.638889:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788863767.638894:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8bff0bb100, transno 4294967309 00000004:00080000:1.0:1788863767.638904:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8bff0b8380, transno 4294967310 00000004:00080000:1.0:1788863767.638909:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788863767.638936:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324011136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863767.639804:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324011520:0@lo:400:kworker.0 00000100:00080000:3.0:1788863767.640185:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863767.640309:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324011392:0@lo:400:kworker.0 00000100:00100000:0.0:1788863767.640372:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863767.640422:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788863767.640429:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759324011264:0@lo:400:kworker.0 00000100:00100000:0.0:1788863767.640462:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863767.640493:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759324011776:0@lo:400:kworker.0 00000100:00100000:0.0:1788863767.640518:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863767.640549:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324011648:0@lo:400:kworker.0 00000100:00100000:0.0:1788863767.640579:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863767.640613:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324011264 00000100:00100000:0.0:1788863767.640623:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324011264 00000100:00100000:0.0:1788863767.640675:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788863767.640684:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759324011264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863767.640740:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759324011264:12345-0@lo:400:kworker.0 Request processed in 57us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863767.640763:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788863767.640803:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324011392 00000100:00100000:0.0:1788863767.640807:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324011392 00000100:00100000:2.0:1788863767.641100:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324011648 00000100:00100000:2.0:1788863767.641105:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324011648 00000100:00100000:2.0:1788863767.641150:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788863767.641159:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324011648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863767.641211:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324011648:12345-0@lo:400:kworker.0 Request processed in 54us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863767.641217:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788863767.641244:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863767.641290:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324011648:0@lo:400:kworker.0 00000100:00100000:2.0:1788863767.641322:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759324011264:0@lo:400:kworker.0 00000100:00100000:1.0:1788863767.641438:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863767.645321:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324011520 00000100:00100000:1.0:1788863767.645345:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324011520 00000100:00100000:1.0:1788863767.645495:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788863767.645515:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324011392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863767.645676:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324011392:12345-0@lo:400:kworker.0 Request processed in 170us (5303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863767.645685:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788863767.645708:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788863767.645715:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759324011520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863767.645755:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759324011520:12345-0@lo:400:kworker.0 Request processed in 41us (4317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863767.645761:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788863767.645846:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324011392:0@lo:400:kworker.0 00000100:00100000:1.0:1788863767.646045:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324011520:0@lo:400:kworker.0 00000100:00100000:0.0:1788863767.646221:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324011776 00000100:00100000:0.0:1788863767.646228:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324011776 00000100:00100000:0.0:1788863767.646276:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788863767.646284:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759324011776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863767.646328:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759324011776:12345-0@lo:400:kworker.0 Request processed in 45us (5808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863767.646334:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788863767.646363:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759324011776:0@lo:400:kworker.0 00000100:00080000:0.0:1788863767.646398:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863767.773272:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863767.775202:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298836736 00000100:00100000:1.0:1788863767.775218:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298836736 00000100:00100000:1.0:1788863767.775319:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:1.0:1788863767.775330:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:10230:x1875759298836736:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788863767.775461:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:10230:x1875759298836736:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 Request processed in 132us (2199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863767.775469:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00080000:0.0:1788863767.776038:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863767.789336:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863767.789508:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298836992 00000100:00100000:0.0:1788863767.789524:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298836992 00000100:00100000:0.0:1788863767.789619:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:0.0:1788863767.789631:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:10230:x1875759298836992:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788863767.790126:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:10230:x1875759298836992:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 496us (806us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788863767.790138:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00010000:00010000:1.0:1788863768.536818:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788863768.740330:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1788863768.741319:0:11975:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788863768.741503:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788863768.741518:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788863769.413273:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863769.413301:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863769.413345:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863769.413380:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863769.413407:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863769.413474:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298837632 00000100:00100000:2.0:1788863769.413486:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298837632 00000100:00100000:2.0:1788863769.413556:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298837248 00000100:00100000:2.0:1788863769.413572:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298837248 00000100:00100000:2.0:1788863769.413596:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 155 00000100:00100000:2.0:1788863769.413607:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2353:x1875759298837632:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863769.413694:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2353:x1875759298837632:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 87us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863769.413702:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 155 00000100:00100000:2.0:1788863769.413720:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 156 00000100:00100000:2.0:1788863769.413726:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd23cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:2353:x1875759298837248:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863769.413752:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd23cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:2353:x1875759298837248:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863769.413757:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 156 00000100:00100000:3.0:1788863769.415547:0:12016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298837376 00000100:00100000:3.0:1788863769.415563:0:12016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298837376 00000100:00100000:3.0:1788863769.415634:0:12016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298837504 00000100:00100000:3.0:1788863769.415638:0:12016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298837504 00000100:00100000:3.0:1788863769.415674:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:3.0:1788863769.415685:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2353:x1875759298837376:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863769.415753:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2353:x1875759298837376:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 71us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863769.415761:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:3.0:1788863769.415777:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:3.0:1788863769.415783:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298837504:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863769.415826:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298837504:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 43us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863769.415832:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:0.0:1788863769.418200:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298837120 00000100:00100000:0.0:1788863769.418214:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298837120 00000100:00100000:0.0:1788863769.418283:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 294 00000100:00100000:0.0:1788863769.418292:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2353:x1875759298837120:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863769.418390:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2353:x1875759298837120:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 98us (5127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863769.418412:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 294 00000100:00080000:0.0:1788863769.418475:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863769.418480:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863769.418484:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788863769.559784:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863769.686846:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324011904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863769.686935:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863769.687114:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324011904 00000100:00100000:1.0:1788863769.687123:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324011904 00000100:00100000:1.0:1788863769.687189:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788863769.687198:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324011904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863769.687235:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863769.687292:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324011904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863769.687299:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788863769.687689:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324011904:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788863769.689343:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788863770.503719:0:12309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 06:36:07 (1788863767) 00010000:00010000:2.0:1788863770.586053:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863771.606243:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863771.722046:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863771.723487:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298837888 00000100:00100000:3.0:1788863771.723507:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298837888 00000100:00100000:3.0:1788863771.723626:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:3.0:1788863771.723644:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:11289:x1875759298837888:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863771.723674:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863771.723704:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb45f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33103e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.723818:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb466 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.723838:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb466 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.723893:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb466 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.723913:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb46d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.723921:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb46d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.723929:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb46d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.726265:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb474 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.727233:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb474 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.727257:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb474 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788863771.727831:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1788863771.728073:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788863771.730088:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb466 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730109:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb466 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730118:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb466 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730123:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863771.730128:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb466 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730135:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb466 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730154:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8bc3015d00) 00010000:00010000:3.0:1788863771.730157:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863771.730162:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb466 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730193:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb466 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730211:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb46d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730217:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb46d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730224:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb46d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730229:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863771.730233:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb46d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730239:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb46d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730247:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e8bc3015900) 00010000:00010000:3.0:1788863771.730250:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863771.730253:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb46d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863771.730259:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb46d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863771.738305:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb45f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33103e expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863771.740824:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb474 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33103e expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863771.740840:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bcb0f5900) 00010000:00010000:2.0:1788863771.740844:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863771.740848:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16000, rc 0) 00000100:00100000:2.0:1788863771.740974:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:11289:x1875759298837888:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 17334us (18945us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788863771.741001:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:1.0:1788863771.749366:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863771.749606:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298838144 00000100:00100000:2.0:1788863771.749626:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298838144 00000100:00100000:2.0:1788863771.749687:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:2.0:1788863771.749698:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:11289:x1875759298838144:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788863771.750367:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:11289:x1875759298838144:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 668us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863771.750377:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:3.0:1788863771.752098:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863771.752380:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298838016 00000100:00100000:0.0:1788863771.752391:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298838016 00000100:00100000:0.0:1788863771.752466:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1788863771.752479:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:2351:x1875759298838016:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863771.752500:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863771.752531:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb474 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33103e expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863771.752555:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bcb0f5900) 00010000:00010000:0.0:1788863771.752561:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863771.752631:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:2351:x1875759298838016:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 154us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863771.752638:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00010000:00010000:1.0:1788863772.630694:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788863772.758261:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788863772.758277:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788863772.758791:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788863772.758803:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788863772.759788:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5773480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324012032:0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.759891:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863772.759952:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759324012544:0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.759986:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863772.760011:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788863772.760018:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759324012160:0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.760038:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863772.760055:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff07dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324012672:0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.760075:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863772.760105:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324012288:0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.760126:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863772.760143:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863772.760148:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324012416:0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.760168:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863772.760219:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324012032 00000100:00100000:0.0:1788863772.760240:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324012032 00000100:00100000:0.0:1788863772.760304:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788863772.760325:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd0f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759324012032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.760400:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd0f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759324012032:12345-0@lo:400:kworker.0 Request processed in 78us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863772.760409:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788863772.760461:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324012544 00000100:00100000:0.0:1788863772.760465:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324012544 00000100:00100000:0.0:1788863772.760513:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324012160 00000100:00100000:0.0:1788863772.760516:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324012160 00000100:00100000:0.0:1788863772.760534:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324012288 00000100:00100000:0.0:1788863772.760537:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324012288 00000100:00100000:0.0:1788863772.760553:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788863772.760559:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759324012544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.760591:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759324012544:12345-0@lo:400:kworker.0 Request processed in 32us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863772.760605:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788863772.760620:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788863772.760625:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759324012160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.760653:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759324012160:12345-0@lo:400:kworker.0 Request processed in 28us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863772.760658:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788863772.760670:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788863772.760675:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324012288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.760707:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324012288:12345-0@lo:400:kworker.0 Request processed in 32us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863772.760712:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788863772.760734:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324012672 00000100:00100000:0.0:1788863772.760737:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324012672 00000100:00100000:0.0:1788863772.760758:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324012416 00000100:00100000:0.0:1788863772.760760:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324012416 00000100:00100000:0.0:1788863772.760774:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788863772.760779:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324012672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.760804:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324012672:12345-0@lo:400:kworker.0 Request processed in 26us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863772.760809:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788863772.760818:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788863772.760823:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324012416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.760841:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324012416:12345-0@lo:400:kworker.0 Request processed in 18us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863772.760846:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1788863772.760894:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863772.760898:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863772.760901:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863772.760956:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324012416:0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.760967:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324012288:0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.761005:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759324012160:0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.761013:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff07dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324012672:0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.761021:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5773480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324012032:0@lo:400:kworker.0 00000100:00100000:0.0:1788863772.761028:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759324012544:0@lo:400:kworker.0 00000100:00100000:2.0:1788863772.761893:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863772.761909:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324012800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863772.761976:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863772.762017:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324012800 00000100:00100000:2.0:1788863772.762023:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324012800 00000100:00100000:2.0:1788863772.762060:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788863772.762067:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324012800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863772.762102:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863772.762142:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324012800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863772.762149:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788863772.762201:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324012800:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788863773.653964:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788863773.903809:0:11973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1788863774.405354:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863774.405654:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298838272 00000100:00100000:1.0:1788863774.405667:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298838272 00000100:00100000:1.0:1788863774.405744:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:1.0:1788863774.405754:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:11331:x1875759298838272:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863774.405776:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863774.405800:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb482 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331045 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.405917:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb489 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.405932:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb489 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.405948:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb489 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.405963:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb490 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.405984:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.405991:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406260:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb489 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406269:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb489 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406276:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb489 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406283:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863774.406288:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb489 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406307:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb489 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406322:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015100) 00010000:00010000:1.0:1788863774.406326:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863774.406332:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb489 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406340:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb489 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406351:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406357:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb490 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406363:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb490 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406368:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863774.406371:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb490 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406377:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb490 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406384:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e8bd20dde00) 00010000:00010000:1.0:1788863774.406387:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863774.406389:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb490 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406405:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb490 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406444:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb482 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331045 expref: 14 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406456:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015100) 00010000:00010000:1.0:1788863774.406458:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863774.406462:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb482 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331045 expref: 14 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.406471:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7ba00, rc 0) 00000100:00100000:1.0:1788863774.406561:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:11331:x1875759298838272:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 807us (1220us total) trans 0 rc 301/301 00000100:00100000:1.0:1788863774.406569:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00080000:0.0:1788863774.407264:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863774.420407:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863774.423632:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298838528 00000100:00100000:1.0:1788863774.423649:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298838528 00000100:00100000:0.0:1788863774.424820:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00100000:0.0:1788863774.424833:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:11331:x1875759298838528:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:0.0:1788863774.424953:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863774.424999:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbae0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e85 expref: 13 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.425017:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015100) 00010000:00010000:0.0:1788863774.425028:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863774.426464:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb497 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.426492:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb497 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.426518:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb497 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.426537:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb49e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.426546:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb49e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.426552:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb49e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863774.429691:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788863774.429710:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb497 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.429721:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb497 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.429729:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb497 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.429736:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863774.429742:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb497 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.429751:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb497 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.429770:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863774.429772:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863774.429785:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb497 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.429792:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb497 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863774.429812:0:6707:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de487add reply state 00000000a388d6eb transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb49e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863774.429820:0:6707:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863774.429963:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:11331:x1875759298838528:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 5126us (9564us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788863774.429985:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 139 00010000:00010000:0.0:1788863774.433701:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb49e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.433733:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb49e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.433744:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb49e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.433751:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18ac00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863774.433758:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb49e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.433768:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb49e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.433793:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e8bcb0f5a00) 00010000:00010000:0.0:1788863774.433797:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863774.433807:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb49e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.433830:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb49e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863774.531483:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863774.531535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863774.531631:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298838784 00000100:00100000:0.0:1788863774.531643:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298838784 00000100:00100000:0.0:1788863774.531721:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:0.0:1788863774.531735:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2353:x1875759298838784:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863774.531832:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2353:x1875759298838784:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 100us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863774.531840:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00080000:0.0:1788863774.531897:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863774.532605:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863774.532644:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863774.533042:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298838656 00000100:00100000:2.0:1788863774.533062:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298838656 00000100:00100000:2.0:1788863774.533106:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 296 00000100:00100000:2.0:1788863774.533114:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2353:x1875759298838656:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863774.533165:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2353:x1875759298838656:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 51us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863774.533172:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 296 00000100:00100000:0.0:1788863774.533373:0:12016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298838912 00000100:00100000:0.0:1788863774.533379:0:12016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298838912 00000100:00100000:0.0:1788863774.533432:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:0.0:1788863774.533440:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298838912:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863774.533473:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2353:x1875759298838912:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 35us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863774.533479:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00080000:1.0:1788863774.533590:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863774.536472:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298839040 00000100:00100000:3.0:1788863774.536498:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298839040 00000100:00100000:3.0:1788863774.536723:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 160 00000100:00100000:3.0:1788863774.536736:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2353:x1875759298839040:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863774.536827:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2353:x1875759298839040:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 95us (5291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863774.536835:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 160 00000100:00080000:1.0:1788863774.547448:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863774.582352:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863774.582442:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298839168 00000100:00100000:2.0:1788863774.582456:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298839168 00000100:00100000:2.0:1788863774.582533:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:2.0:1788863774.582546:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:11339:x1875759298839168:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:2.0:1788863774.582585:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863774.582613:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb4a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33104c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.582698:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb4ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.582715:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb4ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.582729:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb4ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863774.582774:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788863774.582779:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863774.582806:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb4ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.582835:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb4a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33104c expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.582944:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb4ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33104c expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.582954:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330200) 00010000:00010000:2.0:1788863774.582957:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863774.582961:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555a00, rc 0) 00000100:00100000:2.0:1788863774.583046:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:11339:x1875759298839168:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 503us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863774.583053:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 140 00010000:00010000:2.0:1788863774.678336:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863774.680728:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863774.680950:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298839296 00000100:00100000:0.0:1788863774.680962:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298839296 00000100:00100000:0.0:1788863774.681026:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:0.0:1788863774.681038:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:11345:x1875759298839296:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788863774.681062:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863774.681237:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb4b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331053 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681439:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb4ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681455:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb4ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681466:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb4ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681480:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb4c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681486:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681493:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681594:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ba00/0x744cd7666bbbb4c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681603:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ba00/0x744cd7666bbbb4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681609:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ba00/0x744cd7666bbbb4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863774.681637:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788863774.681641:0:6707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788863774.681661:0:6707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ba00/0x744cd7666bbbb4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681685:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb4ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681692:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb4ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681699:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb4ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681705:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863774.681710:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb4ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681718:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb4ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.681730:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330200) 00010000:00010000:0.0:1788863774.682022:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863774.682031:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb4ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.682038:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb4ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.682053:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.682059:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb4c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.682065:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.682175:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18bc00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863774.682180:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.683179:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb4c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.683196:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e8bcb0f5a00) 00010000:00010000:0.0:1788863774.683198:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863774.683203:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb4c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.683209:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb4c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.683431:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb4b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331053 expref: 16 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.683451:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ba00/0x744cd7666bbbb4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331053 expref: 15 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863774.683458:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863774.683461:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788863774.683463:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18ba00, rc 0) 00000100:00100000:2.0:1788863774.683908:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:11345:x1875759298839296:12345-192.168.204.51@tcp:101:bash.0 Request processed in 2695us (3026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863774.683919:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:2.0:1788863774.691365:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863774.691484:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298839552 00000100:00100000:1.0:1788863774.691497:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298839552 00000100:00100000:1.0:1788863774.691607:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00100000:1.0:1788863774.691619:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+15:11345:x1875759298839552:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788863774.691664:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863774.691692:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb4cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33105a expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.692060:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb4d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.692076:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb4d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.692088:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb4d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.692151:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb4dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.692160:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb4dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.692167:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb4dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788863774.697911:0:9496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788863774.699451:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb4e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.699478:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.699495:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.699575:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb4d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.699585:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb4d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.699592:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb4d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.699598:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863774.699603:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb4d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.699612:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb4d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.699624:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:1.0:1788863774.699627:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863774.699632:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb4d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.699638:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb4d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863774.699665:0:9496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006790e7b5 reply state 0000000082542cfa transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb4dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863774.699675:0:9496:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788863774.700499:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb4cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33105a expref: 18 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.700540:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33105a expref: 17 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863774.700550:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bd20dde00) 00010000:00010000:1.0:1788863774.700553:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863774.700557:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a800, rc 0) 00000100:00100000:1.0:1788863774.701010:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:11345:x1875759298839552:12345-192.168.204.51@tcp:101:bash.0 Request processed in 9391us (9657us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788863774.701020:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 142 00010000:00010000:2.0:1788863774.712658:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb4dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.712680:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb4dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.712689:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb4dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.712696:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863774.712701:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb4dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.712756:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb4dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.712776:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bd20dd100) 00010000:00010000:2.0:1788863774.712778:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863774.712784:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb4dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.712791:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb4dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863774.717478:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863774.720584:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298839680 00000100:00100000:3.0:1788863774.720607:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298839680 00000100:00100000:3.0:1788863774.720700:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:3.0:1788863774.720724:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2352:x1875759298839680:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1788863774.720981:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863774.721011:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000542b7bda/0x744cd7666bbbb4f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331061 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788863774.721046:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788863774.721070:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1788863774.721075:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863774.721086:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000542b7bda/0x744cd7666bbbb4f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331061 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863774.721108:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000542b7bda/0x744cd7666bbbb4f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331061 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863774.721123:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17600, rc 0) 00000100:00100000:3.0:1788863774.721206:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2352:x1875759298839680:12345-192.168.204.51@tcp:101:bash.0 Request processed in 484us (3737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863774.721232:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:1.0:1788863774.734921:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863774.735000:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298839808 00000100:00100000:2.0:1788863774.735013:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298839808 00000100:00100000:2.0:1788863774.735083:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1788863774.735096:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:11345:x1875759298839808:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788863774.735118:0:10277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863774.735139:0:10277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331068 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.735173:0:10277:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000542b7bda/0x744cd7666bbbb4f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331061 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.735182:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863774.735187:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863774.735192:0:10277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 7 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.735269:0:10277:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000542b7bda/0x744cd7666bbbb4f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331061 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.735294:0:10277:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000542b7bda/0x744cd7666bbbb4f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331061 expref: 7 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863774.735311:0:10277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee226300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10277:1875759324012928:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863774.735563:0:10277:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf0c79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863774.741938:0:10277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee226300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10277:1875759324012928:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863774.741980:0:10277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 7 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.742003:0:10277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555000, rc 0) 00000100:00100000:3.0:1788863774.742308:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863774.742486:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:11345:x1875759298839808:12345-192.168.204.51@tcp:101:bash.0 Request processed in 7390us (7575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863774.742495:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1788863774.742547:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298839936 00000100:00100000:2.0:1788863774.742554:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298839936 00010000:00010000:2.0:1788863774.742585:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000542b7bda/0x744cd7666bbbb4f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331061 expref: 7 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863774.742622:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:2.0:1788863774.742631:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298839936:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863774.742661:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863774.742688:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000542b7bda/0x744cd7666bbbb4f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331061 expref: 7 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.742701:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000542b7bda/0x744cd7666bbbb4f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331061 expref: 7 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.742739:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000542b7bda/0x744cd7666bbbb4f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331061 expref: 7 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.742762:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863774.742766:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863774.742774:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.742785:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.742820:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863774.742835:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee226300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1875759324013056:192.168.204.51@tcp:105: 00000100:00100000:2.0:1788863774.745170:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf0c79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863774.752509:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863774.753195:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee226300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1875759324013056:192.168.204.51@tcp:105: 00010000:00010000:2.0:1788863774.753220:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863774.753431:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298839936:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 10799us (11122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863774.753442:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:1.0:1788863774.754659:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298840192 00000100:00100000:1.0:1788863774.754673:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298840192 00000100:00100000:0.0:1788863774.754952:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:0.0:1788863774.754963:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+17:11345:x1875759298840192:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:0.0:1788863774.755825:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:11345:x1875759298840192:12345-192.168.204.51@tcp:35:bash.0 Request processed in 859us (3322us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788863774.755889:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:1.0:1788863774.821735:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863774.821780:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324013184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863774.822412:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863774.822566:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324013184 00000100:00100000:0.0:1788863774.822577:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324013184 00000100:00100000:0.0:1788863774.822655:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788863774.822666:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324013184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863774.822717:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863774.822786:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324013184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863774.822792:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788863774.823012:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863774.823071:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324013184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863774.888513:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863774.890418:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298840448 00000100:00100000:2.0:1788863774.890440:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298840448 00000100:00100000:2.0:1788863774.890573:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00100000:2.0:1788863774.890585:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:11355:x1875759298840448:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863774.890624:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863774.890648:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33106f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863774.890769:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788863774.890930:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb500 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33106f expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.890945:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330200) 00010000:00010000:2.0:1788863774.890947:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863774.890952:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33106f expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863774.890966:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554200, rc 0) 00000100:00100000:2.0:1788863774.891035:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:11355:x1875759298840448:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 452us (2534us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788863774.891041:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00100000:2.0:1788863774.895729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863774.896148:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298840704 00000100:00100000:3.0:1788863774.896160:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298840704 00000100:00100000:3.0:1788863774.896407:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:3.0:1788863774.896418:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:11355:x1875759298840704:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1788863774.896817:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:11355:x1875759298840704:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 399us (1111us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788863774.897012:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1788863775.080633:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863775.080899:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298840832 00000100:00100000:2.0:1788863775.080911:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298840832 00000100:00100000:2.0:1788863775.080989:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 144 00000100:00100000:2.0:1788863775.081015:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:11361:x1875759298840832:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863775.081041:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863775.081064:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb50e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331076 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.081156:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.081175:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.081194:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863775.081242:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788863775.081246:0:6707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863775.081269:0:6707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.081302:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb50e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331076 expref: 22 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.081327:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331076 expref: 21 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.081337:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863775.081341:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863775.081345:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555e00, rc 0) 00000100:00100000:2.0:1788863775.081442:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:11361:x1875759298840832:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 429us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863775.081462:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 144 00000100:00100000:1.0:1788863775.094847:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863775.095126:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298841088 00000100:00100000:2.0:1788863775.095140:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298841088 00000100:00100000:2.0:1788863775.095216:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 145 00000100:00100000:2.0:1788863775.095228:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:11361:x1875759298841088:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863775.095253:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863775.095275:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb51c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33107d expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.095387:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb523 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.095403:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.095419:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863775.095436:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788863775.095604:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb51c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33107d expref: 24 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.095637:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb523 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33107d expref: 23 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.095646:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bd20dde00) 00010000:00010000:2.0:1788863775.095650:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863775.095653:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554c00, rc 0) 00000100:00100000:2.0:1788863775.095756:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:11361:x1875759298841088:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 531us (920us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788863775.095764:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 145 00000100:00100000:3.0:1788863775.104045:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863775.104160:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863775.104477:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298841472 00000100:00100000:0.0:1788863775.104491:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298841472 00000100:00100000:0.0:1788863775.104579:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1788863775.104590:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:2353:x1875759298841472:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863775.104607:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863775.104635:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb523 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33107d expref: 23 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.104725:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bd20dde00) 00010000:00010000:0.0:1788863775.104731:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863775.104798:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+22:2353:x1875759298841472:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 210us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863775.104816:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1788863775.107630:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298841344 00000100:00100000:2.0:1788863775.107648:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298841344 00000100:00100000:2.0:1788863775.107778:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:2.0:1788863775.107790:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+22:11361:x1875759298841344:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863775.107829:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863775.107865:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb531 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331084 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.107975:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb538 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.107992:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.108005:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863775.108019:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788863775.108152:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb531 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331084 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.108173:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331084 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.108182:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bd20dde00) 00010000:00010000:2.0:1788863775.108185:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788863775.108202:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555800, rc 0) 00000100:00100000:2.0:1788863775.108458:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:11361:x1875759298841344:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 669us (4423us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788863775.108466:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:2.0:1788863775.122794:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863775.123141:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298841600 00000100:00100000:0.0:1788863775.123157:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298841600 00000100:00100000:0.0:1788863775.123464:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1788863775.123476:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298841600:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:0.0:1788863775.123552:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.123581:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.123590:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788863775.123593:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863775.123599:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.123637:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.123655:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 6 pid: 10277 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863775.123672:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5771180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875759324013312:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863775.123796:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff235600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863775.137512:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863775.138010:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5771180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875759324013312:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863775.138079:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863775.138505:0:6683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298841728 00000100:00100000:3.0:1788863775.138516:0:6683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298841728 00002000:00100000:3.0:1788863775.138679:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e8bee551180 x1875759298841728/t0(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:6/0 lens 504/0 e 0 to 0 dl 1788863786 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788863775.138691:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bee551180 with x1875759298841728 ext(0->12) 00010000:00010000:3.0:1788863775.138704:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 7 pid: 10277 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.138727:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 7 pid: 10277 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788863775.138765:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e8bee551180 00000100:00100000:3.0:1788863775.139009:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1788863775.139024:0:6683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2350:x1875759298841728:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:3.0:1788863775.139976:0:6683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2350:x1875759298841728:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 942us (2482us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788863775.139989:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00002000:00100000:3.0:1788863775.140001:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e8bee551180 x1875759298841728/t4294967305(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:6/0 lens 504/448 e 0 to 0 dl 1788863786 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788863775.140011:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bee551180 with x1875759298841728 ext(0->12) 00010000:00010000:3.0:1788863775.140021:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 9 pid: 10277 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.140051:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 9 pid: 10277 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788863775.140062:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e8bee551180 00000100:00100000:2.0:1788863775.145944:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863775.146494:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298841856 00000100:00100000:3.0:1788863775.146515:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298841856 00010000:00010000:3.0:1788863775.146680:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 9 pid: 10277 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863775.146747:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:3.0:1788863775.146761:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2351:x1875759298841856:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863775.146917:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788863775.146950:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788863775.146954:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788863773 00002000:00010000:3.0:1788863775.146957:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788863774 00002000:00010000:3.0:1788863775.146959:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788863773 00010000:00010000:3.0:1788863775.146966:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 9 pid: 10277 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.146982:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 9 pid: 10277 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.147015:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9561c5/0x744cd7666bbbb4f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331068 expref: 9 pid: 10277 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.147039:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863775.147044:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863775.147052:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.147065:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.147783:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863775.148366:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.148420:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.148480:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.148494:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.148506:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.148537:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863775.148547:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.148563:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.148593:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.148606:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbb546 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863775.148758:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2351:x1875759298841600:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 25278us (25979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863775.148770:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1788863775.153508:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863775.154274:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298841856:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 7499us (8332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863775.154297:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:1.0:1788863775.154571:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298842112 00000100:00100000:1.0:1788863775.154588:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298842112 00000100:00100000:1.0:1788863775.154682:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:1.0:1788863775.154694:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc2e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:11361:x1875759298842112:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:1.0:1788863775.154786:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331084 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863775.155476:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788863775.155529:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788863775.157151:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788863775.157754:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863775.157795:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb4e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33105a expref: 28 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863775.158085:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863775.158135:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33105a expref: 28 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863775.158154:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb4e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33105a expref: 28 pid: 9496 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863775.158173:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0ba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1875759324013440:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863775.158535:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd00c8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788863775.164956:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0ba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1875759324013440:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863775.164993:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863775.165658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863775.165755:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298842240 00000100:00100000:0.0:1788863775.165765:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298842240 00010000:00010000:0.0:1788863775.165829:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb4e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33105a expref: 29 pid: 9496 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863775.165919:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:0.0:1788863775.165939:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:2351:x1875759298842240:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863775.165971:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863775.165987:0:8500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb4e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33105a expref: 29 pid: 9496 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.166005:0:8500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33105a expref: 29 pid: 9496 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.166042:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb4e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33105a expref: 29 pid: 9496 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.166069:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bd20dde00) 00010000:00010000:0.0:1788863775.166080:0:8500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.166093:0:8500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.166130:0:8500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.166188:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863775.166554:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863775.166566:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863775.166733:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788863775.167043:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788863775.167201:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0ba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875759324013568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788863775.167323:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863775.167369:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd00c8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788863775.167748:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324013568 00000100:00100000:2.0:1788863775.167760:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324013568 00000100:00100000:2.0:1788863775.167899:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788863775.167909:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875759324013568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788863775.168016:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875759324013568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863775.168024:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863775.168203:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+30:2351:x1875759298842240:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 2267us (2543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863775.168216:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:1.0:1788863775.168801:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0ba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875759324013568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788863775.169462:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788863775.170192:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd01a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875759324013696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788863775.170328:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863775.170363:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd00c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788863775.170431:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324013696 00000100:00100000:2.0:1788863775.170439:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324013696 00000100:00100000:2.0:1788863775.170489:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863775.170500:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875759324013696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788863775.170736:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875759324013696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 238us (409us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788863775.170745:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788863775.171021:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd01a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875759324013696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788863775.171130:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788863775.171179:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.171190:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.171199:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.171206:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863775.171212:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.171221:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.171243:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bd20dde00) 00010000:00010000:0.0:1788863775.171246:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788863775.171251:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.171288:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb54d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788863775.171662:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788863775.171942:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788863775.171958:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404301105031ns, next at 405301101942ns, rc = 0 00000001:00080000:0.0:1788863775.171969:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788863775.172018:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bd20dde00) 00010000:00010000:0.0:1788863775.172021:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788863775.172030:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb538 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331084 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863775.172185:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc2e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+31:11361:x1875759298842112:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 17491us (18691us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788863775.172196:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000020:00080000:0.0:1788863775.172204:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788863775.186126:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863775.186197:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298842368 00000100:00100000:0.0:1788863775.186210:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298842368 00000100:00100000:0.0:1788863775.186327:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:0.0:1788863775.186346:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+31:11361:x1875759298842368:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863775.186382:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863775.186416:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb554 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33108b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.186491:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33108b expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.186696:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33108b expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.186720:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:0.0:1788863775.186723:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863775.186727:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18b400, rc 0) 00000100:00100000:0.0:1788863775.186845:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:11361:x1875759298842368:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 505us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863775.186894:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:2.0:1788863775.199334:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863775.199496:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298842624 00000100:00100000:3.0:1788863775.199513:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298842624 00000100:00100000:3.0:1788863775.199587:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:3.0:1788863775.199598:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:11361:x1875759298842624:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1788863775.200074:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+33:11361:x1875759298842624:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 474us (751us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788863775.200083:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:1.0:1788863775.356264:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863775.356765:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298842880 00000100:00100000:3.0:1788863775.356786:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298842880 00000100:00100000:3.0:1788863775.357014:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 148 00000100:00100000:3.0:1788863775.357028:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+33:11371:x1875759298842880:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788863775.357059:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863775.357095:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb55b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331092 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863775.357211:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788863775.357383:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb55b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331092 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.357401:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330200) 00010000:00010000:3.0:1788863775.357405:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863775.357441:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb55b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331092 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.357462:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17000, rc 0) 00000100:00100000:3.0:1788863775.360430:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+34:11371:x1875759298842880:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 3371us (4176us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788863775.360448:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 148 00000100:00100000:2.0:1788863775.384127:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863775.384373:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298843008 00000100:00100000:0.0:1788863775.384388:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298843008 00000100:00100000:0.0:1788863775.384496:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 149 00000100:00100000:0.0:1788863775.384513:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+34:11371:x1875759298843008:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:0.0:1788863775.384630:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb569 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.384654:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.384669:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.384691:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.384701:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.384737:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.384951:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.384965:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.384974:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863775.387901:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.387954:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.387966:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb569 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.387976:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.387982:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863775.387988:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.387999:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb569 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.388023:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863775.388037:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863775.388045:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.388052:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.388080:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.388088:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb570 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.388131:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.388137:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18be00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863775.388141:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.388149:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb570 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.388162:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bcb0f5600) 00010000:00010000:2.0:1788863775.388165:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863775.388169:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb570 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.388176:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.388204:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.388212:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb577 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.389035:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.389042:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863775.389046:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.389075:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.389090:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:2.0:1788863775.389093:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863775.389098:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb577 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863775.389105:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863775.389260:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+34:11371:x1875759298843008:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 4746us (5140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863775.389272:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 149 00000100:00100000:0.0:1788863775.405737:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863775.406592:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298843264 00000100:00100000:1.0:1788863775.406607:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298843264 00000100:00100000:1.0:1788863775.409379:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:1.0:1788863775.409415:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+34:11371:x1875759298843264:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788863775.409787:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:11371:x1875759298843264:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 388us (4060us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788863775.409798:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:1.0:1788863775.533036:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863775.535394:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298843520 00000100:00100000:0.0:1788863775.535426:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298843520 00000100:00100000:0.0:1788863775.535632:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:0.0:1788863775.535648:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:11374:x1875759298843520:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863775.535695:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863775.535744:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb57e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331099 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536142:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b200/0x744cd7666bbbb585 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536161:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b200/0x744cd7666bbbb585 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536177:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b200/0x744cd7666bbbb585 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536224:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb58c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536233:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb58c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536240:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb58c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536407:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb593 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536417:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536424:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863775.536437:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788863775.536577:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b200/0x744cd7666bbbb585 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536587:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b200/0x744cd7666bbbb585 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536594:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b200/0x744cd7666bbbb585 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536601:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863775.536605:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b200/0x744cd7666bbbb585 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536625:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b200/0x744cd7666bbbb585 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536642:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863775.536645:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863775.536650:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b200/0x744cd7666bbbb585 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536656:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b200/0x744cd7666bbbb585 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536674:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb58c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536680:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb58c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536686:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb58c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536692:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863775.536695:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb58c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536701:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb58c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536709:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bcb0f5b00) 00010000:00010000:0.0:1788863775.536711:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863775.536713:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb58c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536729:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb58c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.536783:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb57e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331099 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.537273:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331099 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863775.537283:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:0.0:1788863775.537285:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863775.537287:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18be00, rc 0) 00000100:00100000:0.0:1788863775.537365:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+37:11374:x1875759298843520:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1721us (4352us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788863775.537375:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:2.0:1788863775.542244:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863775.542461:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298843648 00000100:00100000:3.0:1788863775.542475:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298843648 00000100:00100000:3.0:1788863775.542642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:3.0:1788863775.542653:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+37:11374:x1875759298843648:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:3.0:1788863775.542734:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.542755:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.542769:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.542804:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.542812:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.542820:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.542826:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863775.542832:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.542841:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.542900:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:3.0:1788863775.542905:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863775.542912:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863775.542930:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863775.543252:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+37:11374:x1875759298843648:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 600us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863775.543272:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:1.0:1788863775.547398:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863775.547790:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298843904 00000100:00100000:3.0:1788863775.547804:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298843904 00000100:00100000:3.0:1788863775.548025:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:3.0:1788863775.548039:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+37:11374:x1875759298843904:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1788863775.548360:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+38:11374:x1875759298843904:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 323us (975us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788863775.548368:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00010000:00010000:0.0:1788863775.702621:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863775.831115:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863775.831126:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863775.831397:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788863775.831405:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788863776.041093:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863776.041253:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298844160 00000100:00100000:2.0:1788863776.041269:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298844160 00000100:00100000:2.0:1788863776.041384:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00080000:3.0:1788863776.041403:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863776.041405:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+38:11405:x1875759298844160:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:2.0:1788863776.041443:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863776.041479:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb5a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310a0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.041635:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.041656:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.041698:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863776.041714:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788863776.041963:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb5a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310a0 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.041986:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310a0 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.041997:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:2.0:1788863776.042000:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863776.042004:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555400, rc 0) 00000100:00100000:2.0:1788863776.042081:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:11405:x1875759298844160:12345-192.168.204.51@tcp:101:cat.0 Request processed in 687us (1015us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788863776.042090:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00100000:2.0:1788863776.049835:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863776.049949:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863776.050106:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298844544 00000100:00100000:3.0:1788863776.050118:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298844544 00000100:00100000:3.0:1788863776.050203:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1788863776.050215:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc66fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:2350:x1875759298844544:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863776.050235:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863776.050280:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310a0 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.050306:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:3.0:1788863776.050312:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863776.050414:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc66fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+39:2350:x1875759298844544:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 201us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863776.050443:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1788863776.051312:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298844416 00000100:00100000:1.0:1788863776.051325:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298844416 00000100:00100000:1.0:1788863776.051393:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:1.0:1788863776.051645:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+39:11405:x1875759298844416:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:1.0:1788863776.052796:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:11405:x1875759298844416:12345-192.168.204.51@tcp:35:cat.0 Request processed in 1138us (2961us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788863776.052808:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:2.0:1788863776.175825:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863776.176032:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298844800 00000100:00100000:0.0:1788863776.176043:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298844800 00000100:00100000:0.0:1788863776.176117:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 153 00000100:00100000:0.0:1788863776.176128:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:11412:x1875759298844800:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1788863776.176157:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863776.176160:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788863776.176193:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb515 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331076 expref: 40 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.176227:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863776.176232:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863776.176248:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b200/0x744cd7666bbbb5bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310a7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.176365:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.176380:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb593 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331099 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.176389:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.176422:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331099 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.176435:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331099 expref: 40 pid: 5840 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863776.176451:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5771180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875759324013824:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863776.176781:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff2353c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863776.181548:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863776.181638:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298844928 00000100:00100000:3.0:1788863776.181649:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298844928 00010000:00010000:3.0:1788863776.181693:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb593 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331099 expref: 41 pid: 5840 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863776.181739:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:3.0:1788863776.181750:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+41:2350:x1875759298844928:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863776.181767:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863776.181776:0:8500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb593 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331099 expref: 41 pid: 5840 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.181791:0:8500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331099 expref: 41 pid: 5840 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.181817:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:3.0:1788863776.181823:0:8500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.181833:0:8500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.181840:0:8500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.181905:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863776.181966:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+41:2350:x1875759298844928:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 217us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863776.181993:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00010000:00010000:1.0:1788863776.182766:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb593 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331099 expref: 40 pid: 5840 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863776.182788:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5771180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875759324013824:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863776.182810:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863776.182819:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863776.182825:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863776.182844:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788863776.183073:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b200/0x744cd7666bbbb5bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310a7 expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863776.183088:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310a7 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863776.183097:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:1.0:1788863776.183100:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788863776.183103:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18a800, rc 0) 00000100:00100000:1.0:1788863776.183557:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:11412:x1875759298844800:12345-192.168.204.51@tcp:101:dd.0 Request processed in 7429us (7747us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788863776.183567:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 153 00000100:00100000:0.0:1788863776.195651:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863776.196376:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298845184 00000100:00100000:3.0:1788863776.196391:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298845184 00000100:00100000:3.0:1788863776.196489:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 154 00000100:00100000:3.0:1788863776.196502:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:11412:x1875759298845184:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:3.0:1788863776.197721:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.197752:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.197769:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863776.199087:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788863776.199141:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a89478d6 reply state 00000000323e45f2 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863776.199156:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863776.200226:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+43:11412:x1875759298845184:12345-192.168.204.51@tcp:36:dd.0 Request processed in 3714us (4579us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788863776.200238:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 154 00000020:00080000:3.0:1788863776.200255:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788863776.205746:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.205765:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.205834:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.205843:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863776.205997:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.206006:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.206023:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:2.0:1788863776.206027:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863776.206031:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.206038:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb5d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863776.726435:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863776.826145:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863776.826259:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298845312 00000100:00100000:2.0:1788863776.826270:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298845312 00000100:00100000:2.0:1788863776.826341:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 155 00000100:00100000:2.0:1788863776.826352:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+42:11426:x1875759298845312:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:2.0:1788863776.826386:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863776.826412:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb5d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310ae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.826485:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb5e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.826499:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.826511:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.826525:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.826543:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.826550:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.826648:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb5ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.826659:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310a7 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.826683:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb5ee lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.826724:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310a7 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.826740:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310a7 expref: 43 pid: 5840 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863776.826754:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee495c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324013952:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863776.826905:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf0c76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863776.834789:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee495c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324013952:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863776.834888:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb5ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863776.844191:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863776.844936:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298845568 00000100:00100000:3.0:1788863776.844952:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298845568 00000100:00100000:3.0:1788863776.845021:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:3.0:1788863776.845031:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+44:5593:x1875759298845568:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788863776.845442:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+45:5593:x1875759298845568:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 411us (1267us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788863776.845474:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:0.0:1788863776.853577:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863776.853726:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298845696 00000100:00100000:3.0:1788863776.853738:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298845696 00010000:00010000:3.0:1788863776.853818:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310a7 expref: 45 pid: 5840 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863776.853927:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:3.0:1788863776.853938:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee226300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+45:2351:x1875759298845696:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863776.853956:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863776.853965:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310a7 expref: 45 pid: 5840 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.853987:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310a7 expref: 45 pid: 5840 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.854016:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb5c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310a7 expref: 45 pid: 5840 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.854033:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:3.0:1788863776.854038:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb5ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.854048:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.854056:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb5ee lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863776.854101:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863776.854182:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee226300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+44:2351:x1875759298845696:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 239us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863776.854198:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00010000:00010000:0.0:1788863776.854922:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.854936:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863776.855007:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788863776.855012:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788863776.855041:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855056:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855074:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855081:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb5e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855089:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb5e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855102:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863776.855108:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb5e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855117:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb5e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855138:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863776.855141:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863776.855147:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb5e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855176:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb5e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855210:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855217:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855229:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855234:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863776.855236:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855242:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855257:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bc9330800) 00010000:00010000:0.0:1788863776.855259:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863776.855262:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855268:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb5e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855333:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb5d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ae expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855349:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb5ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ae expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863776.855373:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:0.0:1788863776.855376:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863776.855379:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554e00, rc 0) 00000100:00100000:0.0:1788863776.855471:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+43:11426:x1875759298845312:12345-192.168.204.51@tcp:101:stat.0 Request processed in 29120us (29337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863776.855481:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 155 00000100:00100000:0.0:1788863776.919664:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863776.919807:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298845952 00000100:00100000:1.0:1788863776.919823:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298845952 00000100:00100000:1.0:1788863776.919986:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 156 00000100:00100000:1.0:1788863776.920000:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+43:11432:x1875759298845952:12345-192.168.204.51@tcp:36:truncate.0 00010000:00010000:1.0:1788863776.920098:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863776.920143:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb5ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ae expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863776.920168:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:1.0:1788863776.920174:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863776.920508:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb5f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863776.920527:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb5f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863776.920538:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb5f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863776.920598:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1788863776.920624:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010d84a55 reply state 00000000cf06fd37 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb5f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863776.920635:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788863776.920774:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+45:11432:x1875759298845952:12345-192.168.204.51@tcp:36:truncate.0 Request processed in 776us (1130us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788863776.920783:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 156 00000020:00080000:1.0:1788863776.920790:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788863776.923758:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb5f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.923806:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb5f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.923814:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb5f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.923821:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863776.923828:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb5f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.923837:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb5f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.923918:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:2.0:1788863776.923921:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863776.923928:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb5f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863776.923934:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb5f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863777.039008:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863777.039142:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298846080 00000100:00100000:3.0:1788863777.039156:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298846080 00000100:00100000:3.0:1788863777.039308:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 157 00000100:00100000:3.0:1788863777.039322:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+44:11446:x1875759298846080:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:3.0:1788863777.039364:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863777.039398:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb5fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310b5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.039492:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb603 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.039513:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.039529:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.039548:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb60a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.039556:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.039564:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.039716:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.039725:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.039733:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863777.039778:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788863777.039784:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863777.039809:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.039824:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.039834:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040041:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb603 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040050:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb603 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040057:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863777.040062:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb603 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040072:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb603 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040095:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:3.0:1788863777.040099:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863777.040106:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb603 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040113:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb603 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040133:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040139:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb60a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040146:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb60a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040152:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863777.040155:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb60a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040162:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb60a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040170:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bc3015f00) 00010000:00010000:3.0:1788863777.040172:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863777.040176:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb60a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040256:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb60a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040313:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb5fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310b5 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040332:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310b5 expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.040340:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:3.0:1788863777.040343:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863777.040346:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17200, rc 0) 00000100:00100000:3.0:1788863777.040507:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+45:11446:x1875759298846080:12345-192.168.204.51@tcp:101:stat.0 Request processed in 1187us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863777.040517:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 157 00000100:00100000:3.0:1788863777.136201:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863777.136335:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298846336 00000100:00100000:0.0:1788863777.136351:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298846336 00000100:00100000:0.0:1788863777.136445:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 158 00000100:00100000:0.0:1788863777.136459:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+45:11456:x1875759298846336:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863777.136496:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863777.136527:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863777.136673:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788863777.136916:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb618 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310bc expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.136938:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330200) 00010000:00010000:0.0:1788863777.136942:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863777.136951:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310bc expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.136973:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18a400, rc 0) 00000100:00100000:0.0:1788863777.137102:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+46:11456:x1875759298846336:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 646us (919us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788863777.137112:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 158 00000100:00100000:2.0:1788863777.141465:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863777.141544:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298846592 00000100:00100000:1.0:1788863777.141560:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298846592 00000100:00100000:1.0:1788863777.141631:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:1.0:1788863777.141645:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc2e8f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+46:11456:x1875759298846592:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788863777.142374:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc2e8f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+47:11456:x1875759298846592:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 727us (922us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788863777.142385:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:1.0:1788863777.242039:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863777.249168:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298846848 00000100:00100000:0.0:1788863777.249192:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298846848 00000100:00100000:0.0:1788863777.249407:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 159 00000100:00100000:0.0:1788863777.249421:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+47:11462:x1875759298846848:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788863777.249588:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863777.249674:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb626 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310c3 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.249815:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.249879:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310b5 expref: 48 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.249893:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.250007:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310b5 expref: 48 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.250033:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310b5 expref: 48 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863777.250054:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8ac19a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6707:1875759324014080:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863777.250201:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff235780 going to sleep for 11 seconds 00000100:00100000:3.0:1788863777.259790:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863777.259918:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298846976 00000100:00100000:0.0:1788863777.259934:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298846976 00010000:00010000:0.0:1788863777.260008:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310b5 expref: 49 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863777.260088:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:3.0:1788863777.260103:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+49:2350:x1875759298846976:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863777.260130:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863777.260142:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310b5 expref: 49 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.260161:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310b5 expref: 49 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.260198:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:3.0:1788863777.260205:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.260244:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.260255:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.260284:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863777.260378:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+49:2350:x1875759298846976:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 279us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863777.260387:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00010000:00010000:1.0:1788863777.260890:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310b5 expref: 48 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863777.260915:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8ac19a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6707:1875759324014080:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863777.260949:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.260962:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.260968:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863777.260993:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788863777.261337:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbb626 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310c3 expref: 49 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.261368:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310c3 expref: 48 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.261395:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:1.0:1788863777.261398:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788863777.261402:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18b600, rc 0) 00000100:00100000:1.0:1788863777.261459:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+48:11462:x1875759298846848:12345-192.168.204.51@tcp:101:bash.0 Request processed in 12042us (19439us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788863777.261468:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 159 00000100:00100000:2.0:1788863777.273789:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863777.274028:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298847232 00000100:00100000:3.0:1788863777.274043:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298847232 00000100:00100000:3.0:1788863777.274128:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 160 00000100:00100000:3.0:1788863777.274141:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+48:11462:x1875759298847232:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:3.0:1788863777.274530:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb63b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.274565:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.274580:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863777.274645:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788863777.274675:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aaac5e1d reply state 00000000792742f7 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863777.274687:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863777.274821:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+51:11462:x1875759298847232:12345-192.168.204.51@tcp:36:bash.0 Request processed in 681us (1046us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788863777.274912:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 160 00000020:00080000:3.0:1788863777.274920:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788863777.280097:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.280124:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb63b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.280133:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb63b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.280165:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863777.280171:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb63b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.280190:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb63b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.280213:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:2.0:1788863777.280217:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863777.281019:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb63b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.281033:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb63b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863777.289376:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863777.290427:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298847360 00000100:00100000:0.0:1788863777.290468:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298847360 00000100:00100000:0.0:1788863777.290583:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 161 00000100:00100000:0.0:1788863777.290596:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:11462:x1875759298847360:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788863777.290643:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863777.290684:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb642 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.290822:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b000/0x744cd7666bbbb649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.290908:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310c3 expref: 51 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.290922:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b000/0x744cd7666bbbb649 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.290985:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310c3 expref: 51 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.291007:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310c3 expref: 51 pid: 6707 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863777.291027:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8ac19a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324014208:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863777.291158:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff235000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863777.301828:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863777.302680:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298847488 00000100:00100000:3.0:1788863777.302696:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298847488 00010000:00010000:3.0:1788863777.302757:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310c3 expref: 52 pid: 6707 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863777.302816:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:3.0:1788863777.302829:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:2351:x1875759298847488:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863777.302886:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863777.302896:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310c3 expref: 52 pid: 6707 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.302913:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310c3 expref: 52 pid: 6707 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.302946:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:3.0:1788863777.302953:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b000/0x744cd7666bbbb649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.302967:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b000/0x744cd7666bbbb649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.302977:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b000/0x744cd7666bbbb649 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.303004:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863777.303075:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:2351:x1875759298847488:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 248us (1265us total) trans 0 rc 0/0 00010000:00010000:2.0:1788863777.305114:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb62d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310c3 expref: 52 pid: 6707 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863777.305157:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8ac19a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324014208:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788863777.305442:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00010000:00010000:2.0:1788863777.305849:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b000/0x744cd7666bbbb649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.305954:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b000/0x744cd7666bbbb649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.305962:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b000/0x744cd7666bbbb649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863777.306496:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788863777.306522:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863777.306564:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b000/0x744cd7666bbbb649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.306617:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb642 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ca expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.306640:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b000/0x744cd7666bbbb649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ca expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.306653:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:2.0:1788863777.306656:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863777.306661:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18b000, rc 0) 00000100:00100000:2.0:1788863777.307914:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:11462:x1875759298847360:12345-192.168.204.51@tcp:101:bash.0 Request processed in 17309us (18546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863777.307927:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 161 00000100:00100000:0.0:1788863777.314917:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863777.315025:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298847744 00000100:00100000:3.0:1788863777.315039:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298847744 00000100:00100000:3.0:1788863777.315123:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:3.0:1788863777.315136:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:11462:x1875759298847744:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:3.0:1788863777.315494:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+51:11462:x1875759298847744:12345-192.168.204.51@tcp:35:bash.0 Request processed in 360us (593us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788863777.315503:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:3.0:1788863777.441488:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863777.441722:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298848000 00000100:00100000:1.0:1788863777.441746:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298848000 00000100:00100000:1.0:1788863777.442032:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 162 00000100:00100000:1.0:1788863777.442049:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+51:11472:x1875759298848000:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863777.442085:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863777.442109:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb650 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310d1 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863777.442211:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788863777.442369:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb650 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310d1 expref: 53 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.442387:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330200) 00010000:00010000:1.0:1788863777.442390:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863777.442406:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310d1 expref: 53 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.442422:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b800, rc 0) 00000100:00100000:1.0:1788863777.442504:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:11472:x1875759298848000:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 460us (1032us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788863777.442525:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 162 00000100:00100000:2.0:1788863777.451967:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863777.452162:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298848128 00000100:00100000:0.0:1788863777.452179:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298848128 00000100:00100000:0.0:1788863777.452277:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:0.0:1788863777.452321:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:11472:x1875759298848128:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:0.0:1788863777.452436:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb65e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.452655:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb65e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.452674:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb65e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.452695:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb665 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.452704:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.452710:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.452977:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb66c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.452988:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb66c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.452996:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb66c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863777.453056:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb66c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.453073:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb65e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.453089:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb65e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.453096:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb65e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.453103:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863777.454576:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb65e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454594:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb65e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454615:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863777.454618:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863777.454624:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb65e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454631:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb65e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454658:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454664:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb665 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454670:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb665 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454675:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18aa00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863777.454698:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb665 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454705:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb665 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454712:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bcb0f5b00) 00010000:00010000:0.0:1788863777.454716:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863777.454719:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb665 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454725:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb665 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454750:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb66c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454756:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb66c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454761:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb66c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454765:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863777.454768:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb66c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454772:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb66c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454779:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:0.0:1788863777.454781:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863777.454789:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb66c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.454795:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb66c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863777.454953:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:11472:x1875759298848128:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 2630us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863777.454963:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:0.0:1788863777.462417:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863777.462540:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298848384 00000100:00100000:3.0:1788863777.462559:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298848384 00000100:00100000:3.0:1788863777.462678:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:3.0:1788863777.462692:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:11472:x1875759298848384:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1788863777.464477:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:11472:x1875759298848384:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 1774us (2069us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788863777.464495:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:1.0:1788863777.508995:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863777.509252:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298848640 00000100:00100000:2.0:1788863777.509267:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298848640 00000100:00100000:2.0:1788863777.509351:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:2.0:1788863777.509364:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+53:11475:x1875759298848640:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863777.509399:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863777.509428:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb673 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.509544:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb67a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.509564:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb67a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.509601:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb67a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.509621:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.509629:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.509636:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.509816:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb688 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.509837:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.509845:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863777.509905:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788863777.510037:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb67a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510046:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb67a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510054:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb67a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510060:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863777.510072:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb67a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510081:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb67a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510096:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863777.510099:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863777.510105:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb67a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510112:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb67a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510127:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510133:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb681 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510139:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510144:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863777.510148:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510154:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb681 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510162:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bc9330700) 00010000:00010000:2.0:1788863777.510165:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863777.510174:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb681 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510180:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb681 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510241:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb673 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310d8 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510258:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb688 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310d8 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.510266:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:2.0:1788863777.510269:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863777.510271:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554c00, rc 0) 00000100:00100000:2.0:1788863777.510910:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:11475:x1875759298848640:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1544us (1929us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788863777.510922:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:2.0:1788863777.515460:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863777.515728:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863777.515841:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298848896 00000100:00100000:0.0:1788863777.515920:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298848896 00000100:00100000:0.0:1788863777.516016:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1788863777.516027:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:2351:x1875759298848896:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863777.516050:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863777.516088:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb688 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310d8 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.516112:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:0.0:1788863777.516118:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863777.516386:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:2351:x1875759298848896:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 359us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863777.516395:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1788863777.517703:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298848768 00000100:00100000:1.0:1788863777.517719:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298848768 00000100:00100000:0.0:1788863777.517971:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:0.0:1788863777.517985:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:11475:x1875759298848768:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1788863777.518090:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb696 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.518144:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.518162:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.518395:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.518405:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb696 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.518414:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.518422:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18aa00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863777.518427:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.518436:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb696 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.518452:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:0.0:1788863777.518456:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863777.518462:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb696 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863777.518469:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb696 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863777.518731:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:11475:x1875759298848768:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 745us (3283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863777.518751:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:2.0:1788863777.523567:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863777.523727:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298849152 00000100:00100000:3.0:1788863777.523740:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298849152 00000100:00100000:3.0:1788863777.523813:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:3.0:1788863777.523836:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:11475:x1875759298849152:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788863777.530762:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:11475:x1875759298849152:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 6922us (7195us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788863777.530782:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:2.0:1788863777.700754:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863777.700982:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298849408 00000100:00100000:1.0:1788863777.701002:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298849408 00000100:00100000:1.0:1788863777.701098:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:1.0:1788863777.701112:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:11493:x1875759298849408:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:1.0:1788863777.701150:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863777.701196:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb69d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310df expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.701369:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb6a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.701392:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.701408:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863777.701425:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788863777.701652:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb69d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310df expref: 58 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.701724:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb6a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310df expref: 57 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.701735:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:1.0:1788863777.701739:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788863777.701744:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7ba00, rc 0) 00000100:00100000:1.0:1788863777.701928:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:11493:x1875759298849408:12345-192.168.204.51@tcp:101:cat.0 Request processed in 743us (1122us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788863777.701939:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:3.0:1788863777.728070:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863777.728416:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298849536 00000100:00100000:2.0:1788863777.728436:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298849536 00000100:00100000:2.0:1788863777.728534:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:2.0:1788863777.728547:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:11494:x1875759298849536:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863777.728590:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863777.728625:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb6b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.728788:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb6b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.728807:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.728836:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863777.728940:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788863777.728945:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863777.728969:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.729002:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb6b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310e6 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.729026:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb6b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310e6 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.729037:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863777.729041:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863777.729046:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554200, rc 0) 00000100:00100000:2.0:1788863777.729437:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:11494:x1875759298849536:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 889us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863777.729447:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:2.0:1788863777.739026:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863777.739482:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298849920 00000100:00100000:3.0:1788863777.739498:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298849920 00000100:00100000:3.0:1788863777.739580:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:3.0:1788863777.739593:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:11494:x1875759298849920:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1788863777.740543:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11494:x1875759298849920:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 616us (1200us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788863777.740560:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:0.0:1788863777.744650:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863777.744891:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298850048 00000100:00100000:2.0:1788863777.744919:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298850048 00000100:00100000:2.0:1788863777.745016:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1788863777.745029:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11494:x1875759298850048:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:2.0:1788863777.745052:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788863777.745103:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b000/0x744cd7666bbbb649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ca expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.745135:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbb6a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310df expref: 58 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.745148:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbb554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33108b expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.745162:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5a00) 00010000:00010000:2.0:1788863777.745302:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863777.745509:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:11494:x1875759298850048:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 482us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863777.745517:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:0.0:1788863777.749451:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863777.749565:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298850176 00000100:00100000:2.0:1788863777.749582:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298850176 00000100:00100000:2.0:1788863777.749791:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:2.0:1788863777.749808:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:11494:x1875759298850176:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:2.0:1788863777.750036:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb6c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.750063:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb6c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.750118:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb6c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788863777.750618:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788863777.750844:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:11494:x1875759298850176:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 1035us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863777.750893:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 168 00010000:00010000:3.0:1788863777.754647:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863777.773925:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863777.774058:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298850304 00000100:00100000:3.0:1788863777.774074:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298850304 00000100:00100000:3.0:1788863777.774178:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:3.0:1788863777.774192:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:11496:x1875759298850304:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788863777.774232:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863777.774264:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb6c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310ed expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.774494:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb6ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.774518:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb6ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.774537:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb6ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.774561:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb6d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.774569:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.774577:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.774843:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.774919:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.774928:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863777.774987:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788863777.774993:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863777.775019:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.775035:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.775046:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb6ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.775054:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb6ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.775062:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb6ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.775070:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863777.775076:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb6ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.775085:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb6ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.775109:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:3.0:1788863777.775113:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863777.775121:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb6ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.775128:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb6ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.775147:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.775153:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb6d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.775158:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.775164:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863777.776338:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.776354:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb6d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.780064:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bc3015f00) 00010000:00010000:3.0:1788863777.780082:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863777.780096:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb6d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.780109:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb6d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.780253:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb6c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ed expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.780276:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ed expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.780285:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:3.0:1788863777.780287:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863777.780291:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17a00, rc 0) 00000100:00100000:3.0:1788863777.780423:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:11496:x1875759298850304:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 6232us (6513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863777.780433:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 169 00000040:00080000:1.0:1788863777.878293:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788863777.878309:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788863777.878413:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788863777.878426:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788863777.878654:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd28d3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875759324014336:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788863777.878700:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324014464:0@lo:400:kworker.0 00000100:00100000:1.0:1788863777.878836:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd00c8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863777.878844:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759324014592:0@lo:400:kworker.0 00000100:00100000:3.0:1788863777.878995:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324014720:0@lo:400:kworker.0 00000100:00100000:2.0:1788863777.886241:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863777.886432:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324015104:0@lo:400:kworker.0 00000100:00100000:2.0:1788863777.886546:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863777.886585:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863777.886594:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324014976:0@lo:400:kworker.0 00000100:00100000:2.0:1788863777.886643:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863777.886700:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324014848:0@lo:400:kworker.0 00000100:00100000:2.0:1788863777.886725:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863777.886765:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324014592 00000100:00100000:2.0:1788863777.886781:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324014592 00000100:00100000:1.0:1788863777.886840:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324014976 00000100:00100000:1.0:1788863777.886846:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324014976 00000100:00100000:2.0:1788863777.886879:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788863777.886889:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759324014592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863777.886906:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788863777.886913:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324014976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863777.886963:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759324014592:12345-0@lo:400:kworker.0 Request processed in 74us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863777.886963:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324014976:12345-0@lo:400:kworker.0 Request processed in 49us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863777.886971:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788863777.886973:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788863777.887024:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324014976:0@lo:400:kworker.0 00000100:00100000:2.0:1788863777.887026:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324015104 00000100:00100000:2.0:1788863777.887029:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324015104 00000100:00100000:1.0:1788863777.887035:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759324014592:0@lo:400:kworker.0 00000100:00100000:2.0:1788863777.887059:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324014848 00000100:00100000:2.0:1788863777.887067:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324014848 00000100:00100000:2.0:1788863777.887093:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788863777.887099:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324015104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863777.887210:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788863777.887219:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875759324014848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863777.887220:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324015104:12345-0@lo:400:kworker.0 Request processed in 121us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863777.887227:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788863777.887266:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875759324014848:12345-0@lo:400:kworker.0 Request processed in 49us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863777.887273:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788863777.887291:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863777.887296:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863777.887299:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863777.887321:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324015104:0@lo:400:kworker.0 00000100:00100000:2.0:1788863777.887425:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324014848:0@lo:400:kworker.0 00000100:00100000:3.0:1788863777.890499:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863777.890602:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324015232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863777.890667:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863777.891964:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd28d3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875759324014336:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788863777.894194:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324014720 00000100:00100000:2.0:1788863777.894209:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324014720 00000100:00100000:2.0:1788863777.894318:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788863777.894333:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324014720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863777.894506:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324014720:12345-0@lo:400:kworker.0 Request processed in 178us (4034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863777.894516:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788863777.895203:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863777.895247:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298850432 00000100:00100000:2.0:1788863777.895254:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298850432 00000100:00100000:2.0:1788863777.895295:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 170 00000100:00100000:2.0:1788863777.895303:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:11507:x1875759298850432:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788863777.895342:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788863777.895510:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863777.895597:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324014464 00000100:00100000:0.0:1788863777.895602:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324014464 00000100:00100000:0.0:1788863777.895637:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788863777.895645:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759324014464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863777.895883:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759324014464:12345-0@lo:400:kworker.0 Request processed in 238us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863777.895892:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788863777.895946:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324015232 00000100:00100000:1.0:1788863777.895952:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324015232 00000100:00100000:0.0:1788863777.895956:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324014464:0@lo:400:kworker.0 00000100:00100000:1.0:1788863777.896009:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788863777.896011:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863777.896019:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324015232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863777.896055:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863777.896096:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324015232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (5429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863777.896103:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788863777.897919:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:11507:x1875759298850432:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 2600us (2706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863777.897937:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 170 00000100:00100000:2.0:1788863777.898053:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324014720:0@lo:400:kworker.0 00000100:00100000:2.0:1788863777.898087:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324015232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863777.915165:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863777.915654:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298850560 00000100:00100000:2.0:1788863777.915671:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298850560 00000100:00100000:2.0:1788863777.915777:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 171 00000100:00100000:2.0:1788863777.915792:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:11507:x1875759298850560:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788863777.915999:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb6e3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.916024:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.916045:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.916070:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6ea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.916089:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.916097:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.916136:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb6f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.916147:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.916155:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863777.918802:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788863777.918838:0:6707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863777.918882:0:6707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.918910:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.918918:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb6e3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.918926:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb6e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.918933:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863777.918939:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb6e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.918948:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb6e3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.918970:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bcb0f5900) 00010000:00010000:2.0:1788863777.918973:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863777.918980:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb6e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.918987:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb6e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.919007:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.919013:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6ea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.919029:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.919035:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863777.919038:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.919044:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6ea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.919052:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8e8bc9330a00) 00010000:00010000:2.0:1788863777.919055:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863777.919058:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6ea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.919064:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6ea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.921006:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.921035:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb6f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.921044:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.921051:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863777.921057:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.921108:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb6f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.921134:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:2.0:1788863777.921138:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863777.921144:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb6f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.921152:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb6f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863777.922943:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:11507:x1875759298850560:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 7131us (7776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863777.922965:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 171 00000100:00100000:1.0:1788863777.936030:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863777.939616:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298850816 00000100:00100000:2.0:1788863777.939645:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298850816 00000100:00100000:2.0:1788863777.939779:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:2.0:1788863777.939794:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:11507:x1875759298850816:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863777.939841:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863777.939902:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310f4 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.940671:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb6ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.940706:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.940728:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863777.940753:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788863777.941026:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.941035:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb6ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.941041:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb6ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.941048:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863777.941053:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb6ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.941062:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb6ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.941076:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:3.0:1788863777.941080:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863777.941086:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb6ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.941091:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb6ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.941156:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6f8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310f4 expref: 59 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.941180:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bcb0f5900) 00010000:00010000:3.0:1788863777.941182:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863777.941187:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb6f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310f4 expref: 59 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.941224:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555600, rc 0) 00000100:00100000:3.0:1788863777.941327:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:11507:x1875759298850816:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1536us (5312us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788863777.941336:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:1.0:1788863777.946648:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863777.946938:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298850944 00000100:00100000:2.0:1788863777.946954:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298850944 00000100:00100000:2.0:1788863777.947032:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:2.0:1788863777.947046:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:11507:x1875759298850944:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788863777.947104:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788863777.947269:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:11507:x1875759298850944:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 226us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863777.947277:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:1.0:1788863777.958752:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863777.959740:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298851200 00000100:00100000:3.0:1788863777.959762:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298851200 00000100:00100000:3.0:1788863777.959880:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 174 00000100:00100000:3.0:1788863777.959894:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:11507:x1875759298851200:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863777.959930:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863777.959934:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788863777.959996:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb6b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310e6 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.960022:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:3.0:1788863777.960028:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863777.960045:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb70d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3310fb expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788863777.960760:0:6707:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788863777.961114:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.961139:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.961154:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.961270:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb70d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310fb expref: 60 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.961295:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310fb expref: 59 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.961304:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bc3015f00) 00010000:00010000:3.0:1788863777.961308:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788863777.961311:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17000, rc 0) 00000100:00100000:3.0:1788863777.961416:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11507:x1875759298851200:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1525us (2687us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788863777.961427:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 174 00000100:00100000:1.0:1788863777.973726:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863777.974102:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298851456 00000100:00100000:3.0:1788863777.974116:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298851456 00000100:00100000:3.0:1788863777.974220:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 175 00000100:00100000:3.0:1788863777.974233:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd28d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11507:x1875759298851456:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788863777.974338:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863777.974394:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310fb expref: 59 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.974423:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bc3015f00) 00010000:00010000:3.0:1788863777.974437:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863777.974485:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb722 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.974506:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.974540:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.974563:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb729 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xdeba91f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.974571:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdeba91f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863777.975314:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdeba91f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975727:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975738:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb722 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975767:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb722 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975775:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863777.975781:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb722 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975790:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb722 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975808:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:1.0:1788863777.975813:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863777.975828:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb722 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975836:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbb722 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975894:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdeba91f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975902:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb729 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdeba91f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975909:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb729 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdeba91f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975915:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863777.975919:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb729 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdeba91f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975935:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb729 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdeba91f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975945:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xdeba91f8 (ffff8e8bc3015200) 00010000:00010000:1.0:1788863777.975947:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863777.975951:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb729 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdeba91f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863777.975957:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb729 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdeba91f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863777.976113:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd28d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:11507:x1875759298851456:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1875us (2397us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788863777.976124:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 175 00000100:00100000:3.0:1788863777.988236:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863777.988757:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298851584 00000100:00100000:2.0:1788863777.988774:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298851584 00000100:00100000:2.0:1788863777.988896:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 176 00000100:00100000:2.0:1788863777.988911:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:11507:x1875759298851584:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863777.988943:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863777.988978:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb730 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331102 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.989033:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.989051:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.989067:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.989196:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331102 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.989230:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331102 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.989241:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:2.0:1788863777.989244:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788863777.989249:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555000, rc 0) 00000100:00100000:2.0:1788863777.989343:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11507:x1875759298851584:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 435us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863777.989350:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 176 00000100:00100000:3.0:1788863777.997307:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863777.998086:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298851840 00000100:00100000:2.0:1788863777.998105:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298851840 00000100:00100000:2.0:1788863777.998190:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 177 00000100:00100000:2.0:1788863777.998205:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11507:x1875759298851840:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788863777.998342:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb73e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.998382:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb73e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863777.998402:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb73e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863778.001135:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788863778.001296:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407130442331ns, next at 408130304832ns, rc = 0 00000004:00010000:1.0:1788863778.001772:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0f9b938 reply state 00000000ec8744b9 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb73e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863778.001789:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788863778.004969:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:11507:x1875759298851840:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 6744us (7661us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788863778.004990:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 177 00010000:00010000:2.0:1788863778.018335:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb73e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.018361:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb73e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.018377:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb73e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.018393:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863778.018402:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb73e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.018413:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb73e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.018482:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:2.0:1788863778.018486:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788863778.018497:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb73e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.018506:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb73e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863778.035074:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863778.035756:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298851968 00000100:00100000:3.0:1788863778.035781:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298851968 00000100:00100000:3.0:1788863778.035932:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 178 00000100:00100000:3.0:1788863778.035945:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:11507:x1875759298851968:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863778.035984:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863778.036014:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb745 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331109 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.036098:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331109 expref: 61 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.036119:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331109 expref: 61 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.036187:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:3.0:1788863778.036192:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788863778.036196:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17000, rc 0) 00000100:00100000:3.0:1788863778.036304:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:11507:x1875759298851968:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 361us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863778.036312:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 178 00000100:00080000:3.0:1788863778.036356:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863778.050551:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863778.052406:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298852096 00000100:00100000:2.0:1788863778.052436:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298852096 00000100:00080000:3.0:1788863778.052742:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863778.052934:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:2.0:1788863778.052953:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2352:x1875759298852096:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788863778.064088:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2352:x1875759298852096:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 11122us (13537us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788863778.064108:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:3.0:1788863778.075126:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863778.080475:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298852352 00000100:00100000:2.0:1788863778.080497:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298852352 00000100:00100000:2.0:1788863778.081534:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1788863778.081553:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:11507:x1875759298852352:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788863778.082061:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+62:11507:x1875759298852352:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 512us (6952us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788863778.082072:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1788863778.089796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863778.089901:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298852608 00000100:00100000:3.0:1788863778.089918:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298852608 00000100:00100000:3.0:1788863778.090002:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 179 00000100:00100000:3.0:1788863778.090017:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+62:11507:x1875759298852608:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788863778.093448:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+62:11507:x1875759298852608:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 3413us (3651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863778.093467:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 179 00000100:00100000:2.0:1788863778.104621:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863778.104774:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298852736 00000100:00100000:3.0:1788863778.104789:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298852736 00000100:00100000:3.0:1788863778.104903:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 180 00000100:00100000:3.0:1788863778.104916:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+62:11507:x1875759298852736:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863778.104954:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863778.104992:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb74c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331110 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.106373:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.106473:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.106491:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863778.106548:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863778.106572:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.106616:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb74c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331110 expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.106638:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331110 expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.106648:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:3.0:1788863778.106652:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788863778.106657:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17600, rc 0) 00000100:00100000:3.0:1788863778.107343:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+63:11507:x1875759298852736:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2423us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863778.107355:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 180 00000100:00100000:3.0:1788863778.114932:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863778.115047:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298852864 00000100:00100000:2.0:1788863778.115063:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298852864 00000100:00100000:2.0:1788863778.115156:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:2.0:1788863778.115180:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2350:x1875759298852864:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863778.115213:0:10277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863778.115250:0:10277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000506575f8/0x744cd7666bbbb75a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331117 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863778.115288:0:10277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe521, blocks: 0x1 00010000:00010000:2.0:1788863778.115313:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=407s v=(0 0) 00010000:00010000:2.0:1788863778.115318:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863778.115330:0:10277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000506575f8/0x744cd7666bbbb75a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331117 expref: 8 pid: 10277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.115359:0:10277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000506575f8/0x744cd7666bbbb75a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331117 expref: 8 pid: 10277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.115376:0:10277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554a00, rc 0) 00000100:00100000:2.0:1788863778.115603:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298852864:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 424us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863778.115611:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:3.0:1788863778.122609:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863778.124025:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298853120 00000100:00100000:0.0:1788863778.124046:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298853120 00000100:00100000:0.0:1788863778.124144:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 181 00000100:00100000:0.0:1788863778.124158:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+63:11507:x1875759298853120:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788863778.124358:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+63:11507:x1875759298853120:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 203us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863778.124367:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 181 00000100:00100000:3.0:1788863778.131196:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863778.131412:0:12016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298853248 00000100:00100000:0.0:1788863778.131428:0:12016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298853248 00000100:00100000:0.0:1788863778.131524:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:0.0:1788863778.131536:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:11507:x1875759298853248:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863778.131565:0:12016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863778.131597:0:12016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33111e expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.131652:0:12016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000506575f8/0x744cd7666bbbb75a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331117 expref: 9 pid: 10277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.131665:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863778.131669:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863778.131675:0:12016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33111e expref: 9 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.131726:0:12016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000506575f8/0x744cd7666bbbb75a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331117 expref: 9 pid: 10277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.131744:0:12016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000506575f8/0x744cd7666bbbb75a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331117 expref: 9 pid: 10277 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863778.131763:0:12016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12016:1875759324015360:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863778.131932:0:12016:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff2353c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863778.135605:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863778.135665:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298853376 00000100:00100000:3.0:1788863778.135679:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298853376 00010000:00010000:3.0:1788863778.135766:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000506575f8/0x744cd7666bbbb75a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331117 expref: 10 pid: 10277 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863778.135823:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:3.0:1788863778.135835:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc66f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:2351:x1875759298853376:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863778.135876:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863778.135910:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000506575f8/0x744cd7666bbbb75a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331117 expref: 10 pid: 10277 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.135927:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000506575f8/0x744cd7666bbbb75a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331117 expref: 10 pid: 10277 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.135961:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863778.135966:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863778.135978:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33111e expref: 10 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.135989:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33111e expref: 10 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.136040:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33111e expref: 10 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863778.136058:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff144380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875759324015488:192.168.204.51@tcp:105: 00000100:00100000:3.0:1788863778.136146:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2bee0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788863778.136936:0:12016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000506575f8/0x744cd7666bbbb75a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331117 expref: 10 pid: 10277 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863778.136962:0:12016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12016:1875759324015360:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863778.137011:0:12016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33111e expref: 9 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.137025:0:12016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18bc00, rc 0) 00000100:00100000:0.0:1788863778.137092:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:11507:x1875759298853248:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 5558us (5917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863778.137103:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:0.0:1788863778.149267:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff144380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875759324015488:192.168.204.51@tcp:105: 00010000:00010000:0.0:1788863778.149301:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863778.149375:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc66f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2351:x1875759298853376:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 13540us (13787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863778.149400:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:1.0:1788863778.152557:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863778.152636:0:6684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298853504 00000100:00100000:0.0:1788863778.152651:0:6684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298853504 00002000:00100000:0.0:1788863778.152718:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e8bfb533100 x1875759298853504/t0(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:9/0 lens 504/0 e 0 to 0 dl 1788863789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863778.152730:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bfb533100 with x1875759298853504 ext(0->8) 00002000:00010000:0.0:1788863778.152737:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bfb533100 00000100:00100000:0.0:1788863778.152781:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1788863778.152792:0:6684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298853504:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788863778.153676:0:6684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:2350:x1875759298853504:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 877us (1128us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788863778.153686:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00002000:00100000:0.0:1788863778.153697:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e8bfb533100 x1875759298853504/t4294967314(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:9/0 lens 504/448 e 0 to 0 dl 1788863789 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863778.153716:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bfb533100 with x1875759298853504 ext(0->8) 00002000:00010000:0.0:1788863778.153722:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bfb533100 00000100:00100000:3.0:1788863778.158285:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863778.158537:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298853632 00000100:00100000:0.0:1788863778.158552:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298853632 00000100:00100000:0.0:1788863778.158625:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 182 00000100:00100000:0.0:1788863778.158638:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+63:11507:x1875759298853632:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788863778.283831:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+63:11507:x1875759298853632:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 125163us (125529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863778.283879:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 182 00000001:00080000:3.0:1788863778.285467:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967445 is committed 00000004:00080000:3.0:1788863778.285512:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:3.0:1788863778.285541:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1788863778.285544:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788863778.285614:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8bd00c8240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788863778.285621:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bd2933d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bd00c8f00 00000020:00080000:3.0:1788863778.285626:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bd2933900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bff00a400 00000001:00080000:3.0:1788863778.285678:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1788863778.285989:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1788863778.286514:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863778.286546:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324015616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788863778.286834:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863778.286980:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324015616 00000100:00100000:2.0:1788863778.286993:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324015616 00000100:00100000:2.0:1788863778.287073:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788863778.287084:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324015616:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1788863778.287580:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00002000:00010000:2.0:1788863778.288665:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788863778.288671:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788863777 00002000:00010000:2.0:1788863778.288674:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788863778.288676:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788863777 -> 1788863777 00002000:00010000:2.0:1788863778.288680:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788863778.288780:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875759324015616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1693us (1944us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788863778.288790:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1788863778.291774:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8bff0b5c00/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788863778.291799:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324015616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788863778.292188:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324015744:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788863778.292290:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863778.292648:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324015744 00000100:00100000:3.0:1788863778.292662:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324015744 00000100:00100000:3.0:1788863778.292731:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788863778.292744:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875759324015744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788863778.292795:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1788863778.292897:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9fe51d, atime: 0x6a9fe51e, ctime: 0x6a9fe51d, blocks: 0x1 00010000:00010000:3.0:1788863778.292907:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009413c94d/0x744cd7666bbbb768 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.292932:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=407s v=(0 0) 00010000:00010000:3.0:1788863778.292938:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863778.292947:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009413c94d/0x744cd7666bbbb768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.292971:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009413c94d/0x744cd7666bbbb768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.292985:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009413c94d/0x744cd7666bbbb768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.293010:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009413c94d/0x744cd7666bbbb768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.293037:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788863778.293777:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875759324015744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1029us (1480us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788863778.293790:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:3.0:1788863778.293890:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863778.293899:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009413c94d/0x744cd7666bbbb768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.293909:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863778.293915:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009413c94d/0x744cd7666bbbb768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.293927:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009413c94d/0x744cd7666bbbb768 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.293950:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009413c94d/0x744cd7666bbbb768 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.293958:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009413c94d/0x744cd7666bbbb768 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.293983:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863778.293994:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863778.293996:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788863778.294306:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8bffe0b800/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788863778.294324:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324015744:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788863778.300464:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863778.300981:0:12016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298853760 00000100:00100000:2.0:1788863778.300999:0:12016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298853760 00000100:00100000:2.0:1788863778.301076:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:2.0:1788863778.301089:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:2350:x1875759298853760:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788863778.365769:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:2350:x1875759298853760:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 64663us (65304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863778.365789:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000001:00080000:1.0:1788863778.365963:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:1.0:1788863778.365986:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1788863778.374843:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863778.374954:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298854016 00000100:00100000:3.0:1788863778.374967:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298854016 00000100:00100000:3.0:1788863778.375047:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 183 00000100:00100000:3.0:1788863778.375058:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:11507:x1875759298854016:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788863778.375131:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863778.375178:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb753 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331110 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.375213:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:3.0:1788863778.375220:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863778.375260:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb76f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.375277:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb76f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.375289:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb76f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863778.375675:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002598c551 reply state 0000000098b5eb65 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb76f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863778.375688:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863778.375918:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:11507:x1875759298854016:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 859us (1091us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788863778.375928:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 183 00010000:00010000:2.0:1788863778.383132:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb76f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.383169:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb76f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.383179:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb76f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.383187:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863778.383193:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb76f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.383211:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb76f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.383234:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:2.0:1788863778.383252:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863778.383260:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb76f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.383267:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb76f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863778.387669:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863778.387762:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298854144 00000100:00100000:2.0:1788863778.387775:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298854144 00000100:00100000:2.0:1788863778.387887:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:2.0:1788863778.387902:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298854144:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788863778.388322:0:10277:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788863778.388327:0:10277:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788863777 -> 1788863776 00002000:00010000:2.0:1788863778.388330:0:10277:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788863774 00002000:00010000:2.0:1788863778.388333:0:10277:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788863777 -> 1788863776 00002000:00010000:2.0:1788863778.388336:0:10277:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788863778.388410:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2351:x1875759298854144:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 511us (754us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788863778.388417:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1788863778.395789:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863778.396018:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298854400 00000100:00100000:3.0:1788863778.396034:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298854400 00000100:00100000:3.0:1788863778.396132:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 184 00000100:00100000:3.0:1788863778.396146:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:11507:x1875759298854400:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788863778.396288:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.396314:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb737 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331102 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.396327:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.396384:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331102 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.396404:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331102 expref: 18 pid: 5841 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863778.396423:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff145c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6707:1875759324015872:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788863778.396558:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2bee9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863778.402724:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff145c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6707:1875759324015872:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863778.402771:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863778.407661:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863778.413452:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298854528 00000100:00100000:2.0:1788863778.413480:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298854528 00010000:00010000:2.0:1788863778.413548:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331102 expref: 19 pid: 5841 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863778.413616:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1788863778.413632:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:2351:x1875759298854528:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863778.413654:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863778.413664:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331102 expref: 19 pid: 5841 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.413681:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331102 expref: 19 pid: 5841 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.413710:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331102 expref: 19 pid: 5841 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.413727:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:2.0:1788863778.413734:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.413745:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.413754:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.413784:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863778.413900:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:2351:x1875759298854528:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 269us (6251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863778.413909:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00010000:00010000:2.0:1788863778.420467:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.420494:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.420551:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.420560:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.420568:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.420575:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863778.420580:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.420589:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.420612:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:2.0:1788863778.420616:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788863778.420622:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.420629:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb776 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863778.420742:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+17:11507:x1875759298854400:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 24591us (24963us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788863778.420754:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 184 00000100:00100000:1.0:1788863778.423961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863778.424084:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298854656 00000100:00100000:2.0:1788863778.424098:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298854656 00000100:00100000:2.0:1788863778.424174:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:2.0:1788863778.424209:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298854656:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788863778.424271:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.424296:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33111e expref: 8 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.424307:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863778.424312:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863778.424317:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.424361:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33111e expref: 8 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.424378:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33111e expref: 8 pid: 12016 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863778.424394:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1875759324016000:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863778.424486:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf0c7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788863778.428297:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863778.428344:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298854784 00000100:00100000:1.0:1788863778.428357:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298854784 00010000:00010000:1.0:1788863778.428416:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33111e expref: 9 pid: 12016 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863778.428465:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:1.0:1788863778.428479:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2351:x1875759298854784:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863778.428504:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863778.428541:0:8500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33111e expref: 9 pid: 12016 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.428556:0:8500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33111e expref: 9 pid: 12016 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.428591:0:8500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863778.428596:0:8500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863778.428605:0:8500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.428639:0:8500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.428671:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863778.428746:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2351:x1875759298854784:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 270us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863778.428755:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00010000:00010000:3.0:1788863778.429884:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ba9dd48/0x744cd7666bbbb761 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33111e expref: 8 pid: 12016 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863778.429912:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1875759324016000:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788863778.429945:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.429957:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.429985:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.430028:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.430040:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.430050:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.430058:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555e00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863778.430063:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.430071:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.430091:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.430099:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f2d4fa2/0x744cd7666bbbb77d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863778.430338:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2350:x1875759298854656:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 6138us (6393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863778.430350:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:2.0:1788863778.437470:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863778.437586:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298855040 00000100:00100000:3.0:1788863778.437601:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298855040 00000100:00100000:3.0:1788863778.437679:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 185 00000100:00100000:3.0:1788863778.437692:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+17:11507:x1875759298855040:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788863778.437803:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb784 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.437838:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.437879:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.438300:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.438315:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb745 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331109 expref: 18 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.438324:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.438371:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331109 expref: 18 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863778.438402:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb745 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331109 expref: 18 pid: 9496 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863778.438420:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff144700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875759324016128:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788863778.438544:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2bee9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863778.444501:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863778.444798:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298855168 00000100:00100000:2.0:1788863778.444822:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298855168 00010000:00010000:2.0:1788863778.444914:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb745 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331109 expref: 19 pid: 9496 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863778.444967:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:2.0:1788863778.444996:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:2350:x1875759298855168:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863778.445018:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863778.445026:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb745 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331109 expref: 19 pid: 9496 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.445040:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb745 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331109 expref: 19 pid: 9496 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.445075:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:2.0:1788863778.445082:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.445093:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.445101:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863778.445123:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863778.445301:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:2350:x1875759298855168:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 208us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863778.445310:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00010000:00010000:0.0:1788863778.446166:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb745 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331109 expref: 18 pid: 9496 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863778.446188:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff144700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875759324016128:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863778.446408:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.446419:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.446443:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863778.446724:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788863778.446984:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788863778.447039:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788863778.447578:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875759324016256:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788863778.447676:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863778.448119:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcb020cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863778.452985:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324016256 00000100:00100000:2.0:1788863778.453015:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324016256 00000100:00100000:3.0:1788863778.453269:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863778.453284:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875759324016256:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788863778.453488:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875759324016256:12345-0@lo:1000:mdt00_002.0 Request processed in 206us (5809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863778.453497:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788863778.455370:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788863778.455385:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8bff0b5c00, transno 4294967315 00000100:00100000:0.0:1788863778.455418:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875759324016256:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788863778.456322:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788863778.456463:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875759324016384:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788863778.456562:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863778.456610:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc74ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1788863778.456654:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324016384 00000100:00100000:0.0:1788863778.456663:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324016384 00000100:00100000:0.0:1788863778.456725:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788863778.456736:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875759324016384:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788863778.457338:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1875759324016384:12345-0@lo:1000:mdt00_002.0 Request processed in 599us (772us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788863778.457350:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788863778.457435:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875759324016384:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788863778.457501:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457525:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457535:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457543:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863778.457550:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457560:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457585:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bc9330a00) 00010000:00010000:0.0:1788863778.457589:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863778.457596:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457603:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb78b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457655:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb6c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457662:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb6c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457669:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb6c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457674:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863778.457681:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb6c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457688:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb6c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457697:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:0.0:1788863778.457700:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863778.457703:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb6c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457710:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb6c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457742:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457762:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ed expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457773:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457827:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ed expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.457871:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ed expref: 21 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863778.457891:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8ac19a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875759324016512:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863778.458024:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863778.463908:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863778.463943:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8ac19a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875759324016512:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863778.463987:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863778.464068:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298855296 00000100:00100000:1.0:1788863778.464088:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298855296 00010000:00010000:1.0:1788863778.464138:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ed expref: 22 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863778.464464:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:1.0:1788863778.464476:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+22:2350:x1875759298855296:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863778.464498:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863778.464506:0:8500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ed expref: 22 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.464521:0:8500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ed expref: 22 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.464549:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb6dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3310ed expref: 22 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.464567:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:1.0:1788863778.464584:0:8500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.464598:0:8500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.464608:0:8500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.464642:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863778.464662:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464670:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464685:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464692:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464699:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464706:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18be00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863778.464711:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863778.464712:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:2350:x1875759298855296:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 238us (823us total) trans 0 rc 0/0 00010000:00010000:0.0:1788863778.464720:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863778.464721:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00010000:00010000:0.0:1788863778.464729:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:0.0:1788863778.464732:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863778.464736:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464743:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb792 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464762:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464767:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb784 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464773:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb784 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464780:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863778.464783:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb784 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464788:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb784 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464795:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bc9330700) 00010000:00010000:0.0:1788863778.464798:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863778.464801:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb784 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863778.464817:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb784 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863778.465180:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:11507:x1875759298855040:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 27489us (27723us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788863778.465190:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 185 00000020:00080000:0.0:1788863778.465195:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788863778.465378:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863778.465384:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863778.465957:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788863778.465971:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788863778.478027:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863778.478479:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298855552 00000100:00100000:1.0:1788863778.478497:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298855552 00000100:00100000:1.0:1788863778.478666:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:1.0:1788863778.478680:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc2e8e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:11507:x1875759298855552:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788863778.479768:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788863778.479971:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788863778.480047:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb799 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.480078:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb799 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.480101:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb799 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.480114:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb799 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.480137:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb799 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.480146:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb799 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.480187:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788863778.480371:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc2e8e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+22:11507:x1875759298855552:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 1685us (2364us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788863778.480384:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000020:00080000:1.0:1788863778.480394:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788863778.481008:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863778.481017:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb799 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.481025:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863778.481030:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb799 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.481040:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb799 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.481057:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8bd20ddf00) 00010000:00010000:1.0:1788863778.481060:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788863778.481066:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb799 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.481072:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb799 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863778.481313:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863778.481315:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863778.481317:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863778.774130:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788863778.918243:0:12457:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788863778.918263:0:12457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788863778.918330:0:12457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788863778.918340:0:12457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1788863779.003810:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1788863779.003882:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788863779.003889:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1788863779.068229:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863779.068304:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298855808 00000100:00100000:0.0:1788863779.068313:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298855808 00000100:00100000:0.0:1788863779.068377:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:0.0:1788863779.068388:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+22:11517:x1875759298855808:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863779.068414:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863779.068433:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb7a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331125 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.068536:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb7a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.068551:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.068566:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863779.068577:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788863779.068694:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb7a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331125 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.068711:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331125 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.068721:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863779.068724:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788863779.068728:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18a600, rc 0) 00000100:00100000:0.0:1788863779.068794:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:11517:x1875759298855808:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 408us (580us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788863779.068826:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:3.0:1788863779.074831:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863779.075353:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298855936 00000100:00100000:2.0:1788863779.075370:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298855936 00000100:00100000:2.0:1788863779.075969:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:2.0:1788863779.075986:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:11517:x1875759298855936:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1788863779.076078:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb7b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076099:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb7b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076114:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb7b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076129:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076136:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076143:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076386:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076395:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076415:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863779.076456:0:6707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076471:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb7b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076485:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb7b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076492:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb7b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076507:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863779.076513:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb7b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076527:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb7b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076540:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863779.076543:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863779.076548:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb7b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076554:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb7b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076566:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076571:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076576:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076580:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863779.076590:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076596:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076603:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bc9330900) 00010000:00010000:2.0:1788863779.076605:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863779.076608:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076613:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076629:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076635:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076640:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076644:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863779.076647:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076664:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076672:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bc9330400) 00010000:00010000:2.0:1788863779.076674:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863779.076684:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.076689:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863779.076811:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:11517:x1875759298855936:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 829us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863779.076820:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:2.0:1788863779.139484:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863779.139581:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298856192 00000100:00100000:0.0:1788863779.139596:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298856192 00000100:00100000:0.0:1788863779.139683:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:0.0:1788863779.139694:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:11520:x1875759298856192:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863779.139718:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863779.139741:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb7ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33112c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.139925:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb7d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.139957:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.139971:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.139989:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb7d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.139997:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140004:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140572:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb7df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140594:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb7df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140602:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb7df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863779.140615:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788863779.140734:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140744:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb7d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140753:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140761:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18ae00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863779.140767:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140775:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb7d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140792:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863779.140807:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863779.140812:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb7d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140818:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb7d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140830:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140844:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb7d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140880:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140886:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18be00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863779.140890:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140898:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb7d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140906:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bcb0f5000) 00010000:00010000:0.0:1788863779.140909:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863779.140912:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb7d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.140918:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb7d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.141415:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb7ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33112c expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.141435:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb7df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33112c expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.141444:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:0.0:1788863779.141447:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863779.141459:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18bc00, rc 0) 00000100:00100000:0.0:1788863779.141548:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+26:11520:x1875759298856192:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1855us (2077us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788863779.141558:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:2.0:1788863779.151167:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863779.151668:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298856320 00000100:00100000:3.0:1788863779.151683:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298856320 00000100:00100000:3.0:1788863779.151778:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:3.0:1788863779.151793:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+26:11520:x1875759298856320:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:3.0:1788863779.151954:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb7ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.151975:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.151991:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.152032:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.152039:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb7ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.152045:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb7ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.152051:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863779.152057:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb7ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.152066:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb7ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.152080:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:3.0:1788863779.152084:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863779.152090:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb7ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.152096:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb7ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863779.152195:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+26:11520:x1875759298856320:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 406us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863779.152203:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:3.0:1788863779.157716:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863779.158072:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298856576 00000100:00100000:2.0:1788863779.158085:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298856576 00000100:00100000:2.0:1788863779.158164:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:2.0:1788863779.158176:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+26:11520:x1875759298856576:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788863779.158536:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:11520:x1875759298856576:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 361us (829us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788863779.158544:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:3.0:1788863779.193449:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863779.193664:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298856832 00000100:00100000:2.0:1788863779.193679:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298856832 00000100:00100000:2.0:1788863779.193762:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 190 00000100:00100000:2.0:1788863779.193775:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:11054:x1875759298856832:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788863779.193818:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863779.193899:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331133 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.194081:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.194110:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb7df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33112c expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.194120:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.194170:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb7df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33112c expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.194188:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb7df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33112c expref: 28 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863779.194205:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6707:1875759324016640:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863779.194617:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf0c7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863779.199708:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863779.201125:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6707:1875759324016640:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863779.201175:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863779.208531:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298856960 00000100:00100000:1.0:1788863779.208557:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298856960 00010000:00010000:1.0:1788863779.208653:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb7df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33112c expref: 29 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863779.208803:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:1.0:1788863779.208826:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff147b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:2351:x1875759298856960:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863779.208847:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863779.208875:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb7df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33112c expref: 29 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.208891:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb7df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33112c expref: 29 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.208920:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb7df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33112c expref: 29 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.208956:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:1.0:1788863779.208965:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.209002:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.209010:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.209051:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863779.209135:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff147b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+28:2351:x1875759298856960:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 321us (9445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863779.209157:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00010000:00010000:3.0:1788863779.218677:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.218705:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863779.218738:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788863779.219029:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554800/0x744cd7666bbbb7f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331133 expref: 29 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.219056:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331133 expref: 28 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.219068:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:3.0:1788863779.219072:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788863779.219077:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554c00, rc 0) 00000100:00100000:3.0:1788863779.219530:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+28:11054:x1875759298856832:12345-192.168.204.51@tcp:101:bash.0 Request processed in 25754us (26095us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788863779.219542:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 190 00000100:00100000:3.0:1788863779.226303:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863779.227351:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298857216 00000100:00100000:2.0:1788863779.227372:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298857216 00000100:00100000:2.0:1788863779.227467:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 191 00000100:00100000:2.0:1788863779.227481:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+28:11054:x1875759298857216:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:2.0:1788863779.229915:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb809 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.230226:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.230343:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788863779.230520:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788863779.230592:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000476d19bb reply state 000000002bd91005 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863779.230604:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788863779.230704:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788863779.233379:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:11054:x1875759298857216:12345-192.168.204.51@tcp:36:bash.0 Request processed in 5878us (7070us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788863779.233397:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 191 00000020:00080000:2.0:1788863779.233411:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788863779.242952:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.242977:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb809 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.242986:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb809 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.242994:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863779.243001:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb809 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.243010:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb809 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.243030:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:1.0:1788863779.243033:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863779.243040:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb809 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.243069:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555c00/0x744cd7666bbbb809 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863779.244113:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863779.244271:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298857344 00000100:00100000:0.0:1788863779.244295:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298857344 00000100:00100000:0.0:1788863779.244373:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 192 00000100:00100000:0.0:1788863779.244388:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+31:11054:x1875759298857344:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788863779.244427:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863779.244459:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb810 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33113a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.244555:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb810 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33113a expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.244579:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb810 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33113a expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.244610:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:0.0:1788863779.244615:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863779.244843:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18be00, rc 0) 00000100:00100000:0.0:1788863779.244946:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:11054:x1875759298857344:12345-192.168.204.51@tcp:101:bash.0 Request processed in 561us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863779.244954:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 192 00000100:00100000:0.0:1788863779.253891:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863779.255102:0:12016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298857472 00000100:00100000:2.0:1788863779.255132:0:12016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298857472 00000100:00100000:2.0:1788863779.255213:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:2.0:1788863779.255223:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:11054:x1875759298857472:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788863779.255246:0:12016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863779.255286:0:12016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001054624d/0x744cd7666bbbb817 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331141 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863779.255324:0:12016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9fe520, atime: 0x6a9fe51e, ctime: 0x6a9fe520, blocks: 0xb 00010000:00010000:2.0:1788863779.255361:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:2.0:1788863779.255366:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863779.255376:0:12016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001054624d/0x744cd7666bbbb817 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331141 expref: 8 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.255427:0:12016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001054624d/0x744cd7666bbbb817 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331141 expref: 8 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.255442:0:12016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554800, rc 0) 00000100:00100000:2.0:1788863779.255522:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:11054:x1875759298857472:12345-192.168.204.51@tcp:101:bash.0 Request processed in 300us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863779.255530:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:1.0:1788863779.263571:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863779.264214:0:6683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298857600 00000100:00100000:3.0:1788863779.264225:0:6683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298857600 00002000:00010000:3.0:1788863779.264277:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788863779.264283:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bff744380 with x1875759298857600 ext(0->18446744073709551615) 00002000:00010000:3.0:1788863779.264295:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bff744380. 00000100:00100000:3.0:1788863779.264407:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1788863779.264418:0:6683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298857600:12345-192.168.204.51@tcp:10:bash.0 00002000:00010000:3.0:1788863779.264697:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788863779.264700:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788863776 -> 1788863778 00002000:00010000:3.0:1788863779.264703:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788863774 -> 1788863774 00002000:00010000:3.0:1788863779.264705:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788863776 -> 1788863778 00002000:00010000:3.0:1788863779.264707:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788863779.264776:0:6683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2350:x1875759298857600:12345-192.168.204.51@tcp:10:bash.0 Request processed in 360us (1215us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788863779.264782:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00002000:00010000:3.0:1788863779.264786:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788863779.264788:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bff744380 with x1875759298857600 ext(0->18446744073709551615) 00002000:00010000:3.0:1788863779.264804:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bff744380. 00000100:00100000:3.0:1788863779.350156:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863779.351329:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298857728 00000100:00100000:2.0:1788863779.351342:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298857728 00000100:00100000:2.0:1788863779.351406:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 193 00000100:00100000:2.0:1788863779.351417:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:11534:x1875759298857728:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1788863779.351497:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb81e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351517:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb81e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351530:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb81e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351547:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351553:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351559:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351824:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb82c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351833:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351841:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863779.351915:0:6707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351929:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb81e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351938:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb81e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351946:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb81e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351952:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863779.351956:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb81e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351964:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb81e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351976:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863779.351979:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863779.351985:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb81e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.351998:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb81e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352011:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352018:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb825 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352024:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352029:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863779.352032:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352037:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb825 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352044:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863779.352046:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863779.352048:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb825 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352054:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352068:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352073:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb82c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352084:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb82c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352089:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863779.352091:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb82c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352097:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb82c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352105:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:2.0:1788863779.352107:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863779.352110:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb82c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.352116:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb82c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863779.352210:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:11534:x1875759298857728:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 792us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863779.352218:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 193 00000100:00100000:0.0:1788863779.402961:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863779.403549:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298857984 00000100:00100000:2.0:1788863779.403564:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298857984 00000100:00100000:2.0:1788863779.403662:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 194 00000100:00100000:2.0:1788863779.403675:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+32:11537:x1875759298857984:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863779.403703:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863779.403729:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb833 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331148 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.403838:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb83a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.403882:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb83a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.403896:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb83a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.403912:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.403919:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.403926:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404214:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404224:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404231:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863779.404242:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788863779.404349:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb83a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404357:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb83a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404372:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb83a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404377:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863779.404383:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb83a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404390:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb83a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404404:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863779.404408:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863779.404414:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb83a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404420:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb83a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404437:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404443:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb841 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404448:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404453:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863779.404456:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404473:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb841 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404481:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863779.404484:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863779.404487:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb841 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404493:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb841 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404546:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb833 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331148 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404560:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331148 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.404568:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:2.0:1788863779.404570:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788863779.404573:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555800, rc 0) 00000100:00100000:2.0:1788863779.404649:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+34:11537:x1875759298857984:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 977us (1704us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788863779.404657:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 194 00000100:00100000:3.0:1788863779.426072:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863779.426521:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298858112 00000100:00100000:0.0:1788863779.426534:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298858112 00000100:00100000:3.0:1788863779.428114:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:3.0:1788863779.428137:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+34:11537:x1875759298858112:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:3.0:1788863779.428220:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.428244:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331133 expref: 34 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.428267:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.428373:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331133 expref: 34 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.428414:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331133 expref: 34 pid: 6707 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863779.428434:0:9496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff144380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9496:1875759324016768:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863779.430088:0:9496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2bee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863779.437807:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863779.437926:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298858368 00000100:00100000:3.0:1788863779.437942:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298858368 00000100:00100000:3.0:1788863779.438018:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:3.0:1788863779.438030:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:5593:x1875759298858368:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788863779.438495:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+36:5593:x1875759298858368:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 466us (709us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788863779.438504:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:2.0:1788863779.439563:0:9496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff144380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9496:1875759324016768:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863779.439592:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863779.445028:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863779.445201:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298858496 00000100:00100000:1.0:1788863779.445216:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298858496 00010000:00010000:1.0:1788863779.445558:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331133 expref: 36 pid: 6707 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863779.445703:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:1.0:1788863779.445718:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+36:2351:x1875759298858496:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863779.445744:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863779.445754:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331133 expref: 36 pid: 6707 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.445772:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331133 expref: 36 pid: 6707 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.445816:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbb7fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331133 expref: 36 pid: 6707 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.445840:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:1.0:1788863779.445846:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.445990:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.446023:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.446067:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863779.446193:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:2351:x1875759298858496:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 478us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863779.446201:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00010000:00010000:3.0:1788863779.446437:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.446447:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.446485:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.446492:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.446500:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.446506:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863779.446518:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.446527:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.446538:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:3.0:1788863779.446541:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788863779.446544:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.446551:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863779.446595:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+34:11537:x1875759298858112:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 18469us (20542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863779.446603:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:1.0:1788863779.455462:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863779.455567:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298858752 00000100:00100000:2.0:1788863779.455577:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298858752 00000100:00100000:2.0:1788863779.455710:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:2.0:1788863779.455724:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+34:11537:x1875759298858752:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788863779.460120:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:11537:x1875759298858752:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 4384us (4655us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788863779.460134:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:0.0:1788863779.576599:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863779.576688:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298859008 00000100:00100000:2.0:1788863779.576698:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298859008 00000100:00100000:2.0:1788863779.576760:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00100000:2.0:1788863779.576770:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+35:11548:x1875759298859008:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:2.0:1788863779.576811:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863779.576835:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb85d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33114f expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.576935:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb864 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.576950:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.576962:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.576978:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb86b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.576985:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb86b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577012:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb86b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577316:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577325:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577332:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863779.577343:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788863779.577456:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577464:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb864 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577471:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577476:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863779.577481:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577488:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb864 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577500:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863779.577503:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863779.577516:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb864 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577522:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbb864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577537:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb86b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577542:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb86b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577547:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb86b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577552:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863779.577554:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb86b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577558:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb86b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577565:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863779.577567:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863779.577570:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb86b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577575:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbb86b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577619:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbb85d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33114f expref: 38 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577648:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33114f expref: 37 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863779.577655:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:2.0:1788863779.577657:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863779.577660:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554a00, rc 0) 00000100:00100000:2.0:1788863779.577730:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+37:11548:x1875759298859008:12345-192.168.204.51@tcp:101:cat.0 Request processed in 960us (1141us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788863779.577739:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00100000:0.0:1788863779.589517:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863779.589739:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298859264 00000100:00100000:3.0:1788863779.589751:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298859264 00000100:00100000:3.0:1788863779.589845:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:3.0:1788863779.589892:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+37:11548:x1875759298859264:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:3.0:1788863779.590518:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+38:11548:x1875759298859264:12345-192.168.204.51@tcp:35:cat.0 Request processed in 662us (1012us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788863779.590527:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:1.0:1788863779.643800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863779.644161:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298859520 00000100:00100000:3.0:1788863779.644173:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298859520 00000100:00100000:3.0:1788863779.644247:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:3.0:1788863779.644258:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+38:11549:x1875759298859520:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:3.0:1788863779.644319:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788863779.644362:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbb872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33114f expref: 38 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.644386:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331148 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.644400:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb810 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33113a expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.644412:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:3.0:1788863779.644421:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788863779.644446:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb880 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.644471:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb880 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.644482:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb880 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.644499:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb887 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.644507:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb887 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.644513:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb887 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645044:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb88e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645064:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb88e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645072:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb88e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788863779.645641:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788863779.645652:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 408774798984ns, next at 409774796519ns, rc = 0 00010000:00010000:3.0:1788863779.645711:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb895 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645721:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645730:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645738:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb895 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645745:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb895 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645753:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645797:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863779.645816:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb88e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645822:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb88e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645835:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb88e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645841:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863779.645846:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb88e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645883:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb88e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645894:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bc3015f00) 00010000:00010000:3.0:1788863779.645897:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788863779.645901:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb88e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645908:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb88e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645926:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb880 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645931:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb880 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645937:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb880 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645943:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863779.645946:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb880 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645964:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb880 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645973:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:3.0:1788863779.645975:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863779.645978:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb880 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.645984:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb880 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863779.645994:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbeda529 reply state 0000000057b7d16e transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb887 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863779.646002:0:5841:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863779.646096:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+37:11549:x1875759298859520:12345-192.168.204.51@tcp:36:rm.0 Request processed in 1837us (2320us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788863779.646105:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:0.0:1788863779.646231:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863779.646353:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863779.646383:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863779.646451:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298859776 00000100:00100000:3.0:1788863779.646458:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298859776 00010000:00010000:1.0:1788863779.646556:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863779.646565:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb895 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.646573:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863779.646577:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb895 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.646586:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.646597:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8bc3015f00) 00010000:00010000:1.0:1788863779.646600:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788863779.646604:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb895 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863779.646605:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00010000:00010000:1.0:1788863779.646615:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17000/0x744cd7666bbbb895 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863779.646619:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2352:x1875759298859776:12345-192.168.204.51@tcp:400:kworker.0 00010000:00010000:1.0:1788863779.646640:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863779.646644:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863779.646651:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298859648 00010000:00010000:1.0:1788863779.646655:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863779.646658:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298859648 00000100:00100000:3.0:1788863779.646672:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2352:x1875759298859776:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 57us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863779.646681:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:2.0:1788863779.646701:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 298 00000100:00100000:3.0:1788863779.646709:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298859904 00000100:00100000:2.0:1788863779.646713:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2352:x1875759298859648:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863779.646715:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298859904 00000100:00100000:2.0:1788863779.646748:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2352:x1875759298859648:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 39us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863779.646755:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 298 00000100:00080000:0.0:1788863779.646761:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863779.646769:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863779.647327:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:2.0:1788863779.647337:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2352:x1875759298859904:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863779.647385:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2352:x1875759298859904:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 50us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863779.647392:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 164 00010000:00010000:3.0:1788863779.648354:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb887 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.648379:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb887 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.648387:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb887 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.648394:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863779.648400:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb887 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.648408:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb887 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.648424:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bc3015400) 00010000:00010000:3.0:1788863779.648427:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863779.648431:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb887 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.648438:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb887 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863779.737253:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863779.737469:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298860160 00000100:00100000:0.0:1788863779.737483:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298860160 00000100:00100000:0.0:1788863779.737555:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 198 00000100:00100000:0.0:1788863779.737567:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+36:11555:x1875759298860160:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788863779.737602:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863779.738191:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb89c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331156 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.742897:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb8a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.742950:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb8a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.742972:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb8a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.743007:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb8aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.743014:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb8aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.743044:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb8aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788863779.743920:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788863779.744162:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb8b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.744175:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.744186:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.744239:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb8a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.744247:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb8a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.744255:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb8a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.744262:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18aa00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863779.744267:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb8a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.744275:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb8a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.744294:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863779.744298:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863779.744313:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb8a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.744320:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18aa00/0x744cd7666bbbb8a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863779.744338:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002404df36 reply state 00000000550372f6 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb8aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863779.744351:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788863779.744403:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb89c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331156 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.744421:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331156 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.744430:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:0.0:1788863779.744433:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863779.744435:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18be00, rc 0) 00000100:00100000:0.0:1788863779.744554:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+39:11555:x1875759298860160:12345-192.168.204.51@tcp:101:bash.0 Request processed in 6988us (7318us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788863779.744564:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 198 00000100:00100000:0.0:1788863779.755167:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863779.756048:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298860288 00000100:00100000:3.0:1788863779.756064:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298860288 00000100:00100000:3.0:1788863779.756157:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:3.0:1788863779.756170:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298860288:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1788863779.756197:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863779.756241:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb8bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33115d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788863779.756624:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788863779.756657:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1788863779.756662:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863779.756676:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb8bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33115d expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.756702:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb8bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33115d expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.756720:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17a00, rc 0) 00000100:00100000:3.0:1788863779.757073:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298860288:12345-192.168.204.51@tcp:101:bash.0 Request processed in 905us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863779.757083:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00010000:00010000:1.0:1788863779.758840:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb8aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.758898:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb8aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.758911:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb8aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.758918:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863779.758924:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb8aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.758934:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb8aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.758959:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bcb0f5000) 00010000:00010000:1.0:1788863779.758963:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863779.758970:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb8aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863779.758977:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b600/0x744cd7666bbbb8aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863779.766505:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863779.766594:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298860416 00000100:00100000:0.0:1788863779.766604:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298860416 00000100:00100000:0.0:1788863779.766657:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:0.0:1788863779.766667:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:11555:x1875759298860416:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788863779.766686:0:10277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863779.766705:0:10277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331164 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.766754:0:10277:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb8bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33115d expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.766764:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863779.766768:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863779.766773:0:10277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 7 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.766829:0:10277:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb8bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33115d expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863779.766844:0:10277:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb8bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33115d expref: 7 pid: 6677 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863779.766892:0:10277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10277:1875759324016896:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863779.767363:0:10277:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863779.786432:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863779.787194:0:10277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10277:1875759324016896:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788863779.787287:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298860544 00010000:00010000:2.0:1788863779.787288:0:10277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 7 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863779.787297:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298860544 00010000:00010000:2.0:1788863779.787319:0:10277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18a000, rc 0) 00010000:00010000:3.0:1788863779.787349:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb8bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33115d expref: 8 pid: 6677 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863779.787405:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:2.0:1788863779.787411:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:11555:x1875759298860416:12345-192.168.204.51@tcp:101:bash.0 Request processed in 20745us (20920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863779.787416:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc66fb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298860544:12345-192.168.204.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788863779.787421:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00010000:00010000:3.0:1788863779.787438:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863779.787472:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb8bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33115d expref: 7 pid: 6677 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.787499:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb8bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33115d expref: 7 pid: 6677 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.787527:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb8bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33115d expref: 7 pid: 6677 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.787544:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863779.787549:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863779.787559:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.787570:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863779.787620:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863779.787639:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1875759324017024:192.168.204.51@tcp:105: 00000100:00100000:3.0:1788863779.787711:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2bee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863779.798094:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863779.798637:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298860800 00000100:00100000:0.0:1788863779.798648:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298860800 00000100:00100000:0.0:1788863779.798716:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:3.0:1788863779.798726:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1875759324017024:192.168.204.51@tcp:105: 00000100:00100000:0.0:1788863779.798726:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+38:11555:x1875759298860800:12345-192.168.204.51@tcp:35:bash.0 00010000:00010000:3.0:1788863779.798757:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863779.799375:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc66fb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2350:x1875759298860544:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 11957us (12954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863779.799385:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:0.0:1788863779.799525:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+39:11555:x1875759298860800:12345-192.168.204.51@tcp:35:bash.0 Request processed in 799us (1441us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788863779.799534:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00010000:00010000:2.0:1788863779.799957:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863779.927068:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324017152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863779.927748:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863779.928101:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324017152 00000100:00100000:0.0:1788863779.928125:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324017152 00000100:00100000:0.0:1788863779.928305:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788863779.928316:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324017152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863779.928362:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863779.928443:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324017152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863779.928462:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788863779.928549:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788863779.928556:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1788863779.928585:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8bffe0b800, transno 4294967307 00000100:00100000:3.0:1788863779.928625:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324017152:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788863779.929437:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863780.054611:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863780.056087:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298860928 00000100:00100000:3.0:1788863780.056563:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298860928 00000100:00080000:1.0:1788863780.056812:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863780.057332:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:3.0:1788863780.057350:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+39:11571:x1875759298860928:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788863780.057382:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863780.057406:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb8cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33116b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.057484:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb8d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.057503:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.057521:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863780.057904:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788863780.057909:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863780.057929:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.057957:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17a00/0x744cd7666bbbb8cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33116b expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.057976:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33116b expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.058001:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:3.0:1788863780.058004:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863780.058009:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16000, rc 0) 00000100:00100000:3.0:1788863780.058094:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:11571:x1875759298860928:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 751us (3497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863780.058103:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:1.0:1788863780.066664:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863780.067549:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298861184 00000100:00100000:2.0:1788863780.067568:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298861184 00000100:00100000:2.0:1788863780.067649:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 200 00000100:00100000:2.0:1788863780.067664:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+40:11571:x1875759298861184:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863780.067696:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863780.067729:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb8db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331172 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.067935:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb8e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.067952:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.067968:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863780.067983:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788863780.068313:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb8db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331172 expref: 43 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.068362:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331172 expref: 42 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.068373:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:2.0:1788863780.068376:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863780.068380:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555000, rc 0) 00000100:00100000:2.0:1788863780.068472:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+42:11571:x1875759298861184:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 811us (1828us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788863780.068482:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 200 00000100:00100000:2.0:1788863780.076774:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863780.077508:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298861568 00000100:00100000:1.0:1788863780.077549:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298861568 00000100:00100000:1.0:1788863780.077658:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1788863780.077671:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+42:2353:x1875759298861568:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863780.077694:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863780.077747:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb8e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331172 expref: 42 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.077774:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:1.0:1788863780.077791:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863780.078286:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+41:2353:x1875759298861568:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 615us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863780.078297:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1788863780.080711:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863780.081551:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298861440 00000100:00100000:0.0:1788863780.081566:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298861440 00000100:00100000:0.0:1788863780.081702:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 201 00000100:00100000:0.0:1788863780.081713:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+41:11571:x1875759298861440:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863780.081738:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863780.081758:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb8f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331179 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.081916:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb8f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.081940:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.081952:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863780.081973:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788863780.082140:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ac00/0x744cd7666bbbb8f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331179 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.082193:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb8f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331179 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.082202:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:0.0:1788863780.082205:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788863780.082208:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18a800, rc 0) 00000100:00100000:0.0:1788863780.082288:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+43:11571:x1875759298861440:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 576us (1588us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788863780.082296:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 201 00000100:00100000:0.0:1788863780.095065:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863780.095224:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298861696 00000100:00100000:3.0:1788863780.095240:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298861696 00000100:00100000:3.0:1788863780.095308:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:3.0:1788863780.095320:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+6:2351:x1875759298861696:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:3.0:1788863780.095373:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.095396:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.095405:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788863780.095409:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863780.095413:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.095447:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 6 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.095483:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 6 pid: 10277 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863780.095498:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6680:1875759324017280:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788863780.095594:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2bee9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863780.100288:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863780.100438:0:6685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298861824 00000100:00100000:2.0:1788863780.100448:0:6685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298861824 00002000:00100000:2.0:1788863780.100500:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e8bedc8c380 x1875759298861824/t0(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:11/0 lens 504/0 e 0 to 0 dl 1788863791 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863780.100512:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bedc8c380 with x1875759298861824 ext(0->8) 00010000:00010000:2.0:1788863780.100521:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 7 pid: 10277 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.100538:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 7 pid: 10277 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863780.100546:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e8bedc8c380 00000100:00100000:2.0:1788863780.100581:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1788863780.100591:0:6685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2350:x1875759298861824:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:2.0:1788863780.101259:0:6685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2350:x1875759298861824:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 667us (980us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788863780.101269:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00002000:00100000:2.0:1788863780.101277:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e8bedc8c380 x1875759298861824/t4294967308(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:11/0 lens 504/448 e 0 to 0 dl 1788863791 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788863780.101285:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bedc8c380 with x1875759298861824 ext(0->8) 00010000:00010000:2.0:1788863780.101291:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 9 pid: 10277 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.101306:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 9 pid: 10277 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863780.101314:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e8bedc8c380 00000100:00100000:3.0:1788863780.102602:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6680:1875759324017280:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788863780.102628:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863780.106200:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863780.106312:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298861952 00000100:00100000:1.0:1788863780.106326:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298861952 00010000:00010000:1.0:1788863780.106376:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 9 pid: 10277 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863780.106422:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:1.0:1788863780.106432:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2350:x1875759298861952:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863780.106450:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788863780.106475:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788863780.106478:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788863778 00002000:00010000:1.0:1788863780.106481:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788863779 00002000:00010000:1.0:1788863780.106483:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788863778 00010000:00010000:1.0:1788863780.106489:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 9 pid: 10277 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.106528:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 9 pid: 10277 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.106563:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000078ab281/0x744cd7666bbbb8c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331164 expref: 9 pid: 10277 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.106585:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863780.106589:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788863780.106596:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.106607:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.106661:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863780.106748:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298861952:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 318us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863780.106756:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00010000:00010000:0.0:1788863780.108020:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.108037:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.108071:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.108080:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.108088:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.108114:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17a00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863780.108118:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.108139:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.108156:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.108164:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b673f5/0x744cd7666bbbb905 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863780.108259:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298861696:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 12940us (13203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863780.108269:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:0.0:1788863780.113892:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863780.114093:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298862208 00000100:00100000:1.0:1788863780.114105:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298862208 00000100:00100000:1.0:1788863780.114175:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:1.0:1788863780.114183:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc2e8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+43:11571:x1875759298862208:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:1.0:1788863780.114262:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb8f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331179 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863780.114557:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788863780.114604:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788863780.115708:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788863780.116327:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.116350:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb8b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331156 expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.116360:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.116404:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331156 expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.116422:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb8b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331156 expref: 47 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863780.116441:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875759324017408:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863780.116546:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc8a2d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788863780.121659:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863780.122345:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298862336 00000100:00100000:0.0:1788863780.122356:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298862336 00010000:00010000:0.0:1788863780.122406:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb8b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331156 expref: 48 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863780.122454:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:0.0:1788863780.122466:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+48:2351:x1875759298862336:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863780.122482:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863780.122498:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb8b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331156 expref: 48 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.122512:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb8b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331156 expref: 48 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.122538:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:0.0:1788863780.122544:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.122555:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.122562:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.122581:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863780.122648:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+48:2351:x1875759298862336:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 184us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863780.122656:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00010000:00010000:3.0:1788863780.123737:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb8b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331156 expref: 47 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863780.123759:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875759324017408:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788863780.124292:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.124306:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.124313:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863780.124459:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788863780.124681:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788863780.124876:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff146300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875759324017536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788863780.129074:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863780.129419:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc133acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863780.129476:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324017536 00000100:00100000:0.0:1788863780.129487:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324017536 00000100:00100000:0.0:1788863780.129584:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788863780.129594:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875759324017536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788863780.129712:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875759324017536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 120us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863780.129720:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863780.129833:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff146300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875759324017536:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788863780.131349:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788863780.131460:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffce2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875759324017664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788863780.131529:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863780.132378:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc8a2db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863780.132438:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324017664 00000100:00100000:2.0:1788863780.132447:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324017664 00000100:00100000:2.0:1788863780.132496:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788863780.132505:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875759324017664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788863780.133116:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875759324017664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 608us (1583us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788863780.133345:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffce2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875759324017664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788863780.133447:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788863780.133504:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.133515:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.133526:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.133533:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863780.133538:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.133547:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.133566:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:1.0:1788863780.133570:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788863780.133576:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.133584:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbb90c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863780.134359:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1788863780.134440:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788863780.134588:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788863780.134601:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409263748822ns, next at 410263745698ns, rc = 0 00000001:00080000:1.0:1788863780.134610:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788863780.134655:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bcb0f5b00) 00010000:00010000:1.0:1788863780.134675:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788863780.134684:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb8f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331179 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863780.135146:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc2e8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:11571:x1875759298862208:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 20960us (21299us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788863780.135157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000020:00080000:1.0:1788863780.135162:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788863780.144401:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863780.144496:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298862464 00000100:00100000:3.0:1788863780.144512:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298862464 00000100:00100000:3.0:1788863780.144592:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 202 00000100:00100000:3.0:1788863780.144603:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+50:11571:x1875759298862464:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788863780.144630:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863780.144675:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb913 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.144761:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb913 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331180 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.144903:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb913 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331180 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.144938:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:3.0:1788863780.144942:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788863780.144946:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17200, rc 0) 00000100:00100000:3.0:1788863780.145011:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+51:11571:x1875759298862464:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 409us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863780.145019:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 202 00000100:00100000:2.0:1788863780.151295:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863780.151450:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298862720 00000100:00100000:0.0:1788863780.151466:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298862720 00000100:00100000:0.0:1788863780.151569:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1788863780.151583:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+51:11571:x1875759298862720:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788863780.152355:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:11571:x1875759298862720:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 771us (1071us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788863780.152367:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:3.0:1788863780.244500:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863780.244771:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298862848 00000100:00100000:2.0:1788863780.244790:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298862848 00000100:00100000:2.0:1788863780.244901:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 203 00000100:00100000:2.0:1788863780.244925:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:11581:x1875759298862848:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1788863780.245010:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb91a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245029:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb91a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245042:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb91a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245060:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb921 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245068:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245075:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245174:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb928 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245183:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245189:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863780.245228:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245241:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb91a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245254:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb91a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245261:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb91a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245267:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863780.245277:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb91a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245285:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb91a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245299:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863780.245302:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863780.245306:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb91a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245312:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb91a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245327:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245333:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb921 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245339:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245343:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863780.245352:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245359:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb921 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245367:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863780.245369:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863780.245372:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb921 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245378:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245394:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245401:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb928 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245406:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245411:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863780.245414:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245420:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb928 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245428:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:2.0:1788863780.245430:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863780.245441:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb928 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.245446:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb928 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863780.245537:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:11581:x1875759298862848:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 614us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863780.245546:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 203 00000100:00100000:1.0:1788863780.320925:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863780.322886:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298863104 00000100:00100000:0.0:1788863780.322903:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298863104 00000100:00100000:0.0:1788863780.323029:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 204 00000100:00100000:0.0:1788863780.323040:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+52:11584:x1875759298863104:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863780.323060:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863780.323094:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb92f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331187 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323191:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb936 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323206:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb936 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323219:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb936 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323235:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb93d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323241:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb93d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323249:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb93d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323395:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb944 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323405:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323412:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863780.323421:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788863780.323523:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb936 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323531:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb936 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323539:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb936 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323544:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18bc00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863780.323549:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb936 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323556:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb936 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323568:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:0.0:1788863780.323571:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863780.323575:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb936 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323591:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18bc00/0x744cd7666bbbb936 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323605:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb93d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323610:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb93d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323615:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb93d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323620:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863780.323623:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb93d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323629:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb93d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323636:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bcb0f5a00) 00010000:00010000:0.0:1788863780.323639:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863780.323642:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb93d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323647:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb93d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323684:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ae00/0x744cd7666bbbb92f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331187 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323697:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331187 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.323711:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:0.0:1788863780.323713:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863780.323716:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18a800, rc 0) 00000100:00100000:0.0:1788863780.323804:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:11584:x1875759298863104:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 766us (2890us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788863780.323812:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 204 00000100:00100000:3.0:1788863780.332075:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863780.333611:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298863232 00000100:00100000:1.0:1788863780.333625:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298863232 00000100:00100000:1.0:1788863780.333768:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 205 00000100:00100000:1.0:1788863780.333793:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:11584:x1875759298863232:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:1.0:1788863780.333901:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.333920:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.333934:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.333966:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.333973:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb952 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.333982:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.334021:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863780.334025:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.334033:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.334044:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:1.0:1788863780.334047:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863780.334052:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb952 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.334057:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbb952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863780.334148:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:11584:x1875759298863232:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 358us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863780.334156:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 205 00000100:00100000:1.0:1788863780.339179:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863780.340502:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298863488 00000100:00100000:2.0:1788863780.340521:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298863488 00000100:00100000:2.0:1788863780.340599:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:2.0:1788863780.340611:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+54:11584:x1875759298863488:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788863780.341179:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:11584:x1875759298863488:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 568us (2014us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788863780.341187:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:0.0:1788863780.456571:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863780.456656:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298863744 00000100:00100000:2.0:1788863780.456666:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298863744 00000100:00100000:2.0:1788863780.456725:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:2.0:1788863780.456735:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+55:11594:x1875759298863744:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788863780.456762:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863780.456765:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788863780.456803:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16000/0x744cd7666bbbb8d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33116b expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.457102:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863780.457108:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863780.457126:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb959 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33118e expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.457403:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.457417:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.457429:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863780.457440:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788863780.457570:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb959 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33118e expref: 57 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.457587:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33118e expref: 56 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.457594:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:2.0:1788863780.457597:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863780.457600:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555e00, rc 0) 00000100:00100000:2.0:1788863780.457668:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:11594:x1875759298863744:12345-192.168.204.51@tcp:101:bash.0 Request processed in 933us (1109us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788863780.457676:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:3.0:1788863780.465963:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863780.466178:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298864000 00000100:00100000:0.0:1788863780.466189:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298864000 00000100:00100000:0.0:1788863780.466247:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:0.0:1788863780.466257:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:11594:x1875759298864000:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:0.0:1788863780.466333:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788863780.466362:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbb960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33118e expref: 56 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.466383:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbb944 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331187 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.466394:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:0.0:1788863780.466399:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863780.466629:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb96e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.466642:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb96e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.466652:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb96e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863780.466750:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788863780.466783:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff51e010 reply state 00000000dfba61f6 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb96e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863780.466793:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863780.466931:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:11594:x1875759298864000:12345-192.168.204.51@tcp:36:bash.0 Request processed in 674us (982us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788863780.466938:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 207 00000020:00080000:0.0:1788863780.466943:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788863780.471176:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb96e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.471199:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb96e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.471226:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb96e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.471231:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863780.471236:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb96e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.471245:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb96e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.471264:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:3.0:1788863780.471268:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863780.471272:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb96e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.471278:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a200/0x744cd7666bbbb96e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863780.474066:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863780.474692:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298864128 00000100:00100000:1.0:1788863780.474704:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298864128 00000100:00100000:1.0:1788863780.474785:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 208 00000100:00100000:1.0:1788863780.474796:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+56:11594:x1875759298864128:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788863780.474822:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863780.474981:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb975 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331195 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.475106:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb97c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.475142:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb97c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.475801:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb97c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863780.476874:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788863780.476883:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788863780.476914:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb97c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.476964:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbb975 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331195 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.476986:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb97c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331195 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.476996:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:1.0:1788863780.476998:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863780.477002:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b800, rc 0) 00000100:00100000:1.0:1788863780.477097:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:11594:x1875759298864128:12345-192.168.204.51@tcp:101:bash.0 Request processed in 2301us (3041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863780.477106:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 208 00000100:00100000:1.0:1788863780.482818:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863780.488005:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298864384 00000100:00100000:2.0:1788863780.488021:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298864384 00000100:00100000:2.0:1788863780.488104:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:2.0:1788863780.488116:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+57:11594:x1875759298864384:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1788863780.488488:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:11594:x1875759298864384:12345-192.168.204.51@tcp:35:bash.0 Request processed in 373us (5685us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788863780.488509:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:0.0:1788863780.635000:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863780.635118:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298864512 00000100:00100000:3.0:1788863780.635131:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298864512 00000100:00100000:3.0:1788863780.635209:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:3.0:1788863780.635221:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+58:11600:x1875759298864512:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788863780.635259:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863780.635291:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb983 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33119c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.635385:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb98a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.635419:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb98a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.635432:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb98a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863780.635478:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788863780.635481:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863780.635505:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb98a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.635534:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbb983 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33119c expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.635558:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb98a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33119c expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.635570:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:3.0:1788863780.635574:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863780.635578:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16400, rc 0) 00000100:00100000:3.0:1788863780.635781:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11600:x1875759298864512:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 561us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863780.635790:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:3.0:1788863780.650825:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863780.650993:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298864640 00000100:00100000:2.0:1788863780.651007:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298864640 00000100:00100000:2.0:1788863780.651074:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:2.0:1788863780.651085:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11600:x1875759298864640:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863780.651123:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863780.651150:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb991 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311a3 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651235:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb998 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651252:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651266:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651282:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb99f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651288:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb99f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651294:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb99f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651398:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651434:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651443:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863780.651497:0:6707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788863780.651502:0:6707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863780.651528:0:6707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651541:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651549:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651556:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb998 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651563:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb998 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651570:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863780.651574:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb998 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651582:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb998 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651595:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863780.651598:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863780.651612:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb998 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651619:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb998 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651635:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb99f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651641:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb99f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651647:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb99f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651653:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863780.651657:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb99f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651662:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb99f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651669:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863780.651671:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863780.651674:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb99f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651678:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb99f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651713:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbb991 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311a3 expref: 61 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651738:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311a3 expref: 60 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.651746:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:2.0:1788863780.651748:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863780.651751:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555200, rc 0) 00000100:00100000:2.0:1788863780.651880:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:11600:x1875759298864640:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 765us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863780.651890:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:3.0:1788863780.669378:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863780.669446:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863780.669541:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298864768 00000100:00100000:2.0:1788863780.669554:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298864768 00000100:00100000:2.0:1788863780.669633:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1788863780.669646:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:2351:x1875759298864768:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863780.669667:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863780.669699:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311a3 expref: 60 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.669722:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:2.0:1788863780.669728:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863780.669831:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:2351:x1875759298864768:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 188us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863780.669839:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:0.0:1788863780.670924:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298865024 00000100:00100000:0.0:1788863780.670934:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298865024 00000100:00100000:0.0:1788863780.670987:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:0.0:1788863780.670996:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11600:x1875759298865024:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863780.671020:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863780.671044:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb9ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.671189:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.671208:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb97c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331195 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.671217:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.671266:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb97c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331195 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.671303:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb97c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331195 expref: 60 pid: 5840 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863780.671320:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff176680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875759324017792:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863780.671411:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863780.676006:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff176680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875759324017792:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863780.676046:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863780.683264:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863780.683580:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298865152 00000100:00100000:0.0:1788863780.683599:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298865152 00010000:00010000:0.0:1788863780.683681:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb97c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331195 expref: 61 pid: 5840 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863780.683755:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:0.0:1788863780.683785:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:2353:x1875759298865152:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863780.683811:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863780.683820:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb97c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331195 expref: 61 pid: 5840 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.683839:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb97c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331195 expref: 61 pid: 5840 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.683922:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbb97c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331195 expref: 61 pid: 5840 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.683980:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:0.0:1788863780.683988:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.684001:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.684011:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863780.684044:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863780.684357:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:2353:x1875759298865152:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 588us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863780.684365:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00010000:00010000:1.0:1788863780.685920:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.685941:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863780.686000:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788863780.686499:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbb9ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311aa expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.686521:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311aa expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863780.686532:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:1.0:1788863780.686535:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788863780.686538:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18a000, rc 0) 00000100:00100000:1.0:1788863780.686632:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:11600:x1875759298865024:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 15635us (17183us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788863780.686643:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:2.0:1788863780.701926:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863780.705650:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298865408 00000100:00100000:1.0:1788863780.705670:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298865408 00000100:00100000:2.0:1788863780.705944:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1788863780.705990:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:11600:x1875759298865408:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:2.0:1788863780.706017:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863780.706048:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17200/0x744cd7666bbbb913 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331180 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.706073:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:2.0:1788863780.706078:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863780.706184:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11600:x1875759298865408:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 198us (4331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863780.706194:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1788863780.717145:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863780.717733:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298865536 00000100:00100000:2.0:1788863780.717749:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298865536 00000100:00100000:2.0:1788863780.717842:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:2.0:1788863780.717910:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11600:x1875759298865536:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:2.0:1788863780.718057:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.718499:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863780.718517:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788863780.718809:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788863780.720459:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11600:x1875759298865536:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 2589us (3314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863780.720477:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:0.0:1788863780.728525:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863780.728670:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298865664 00000100:00100000:3.0:1788863780.728702:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298865664 00000100:00100000:3.0:1788863780.728799:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:3.0:1788863780.728815:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+59:11600:x1875759298865664:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788863780.731421:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863780.731475:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb9c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311b1 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.731591:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9c2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.731613:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb9c9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311b1 expref: 60 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.731646:0:9496:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.731671:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb9c9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311b1 expref: 60 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.731691:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:3.0:1788863780.731694:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788863780.731698:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb9c9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311b1 expref: 60 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863780.731706:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16c00, rc 0) 00000100:00100000:3.0:1788863780.731833:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:11600:x1875759298865664:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 3020us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863780.731843:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 213 00010000:00010000:1.0:1788863780.823307:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863781.526148:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863781.526158:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863781.526198:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788863781.526205:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788863781.526360:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff744a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875759324017920:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788863781.526464:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8be1ed4240 going to sleep for 11 seconds 00000100:00100000:3.0:1788863781.536178:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff744a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875759324017920:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788863781.541808:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863781.545776:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298865792 00000100:00100000:0.0:1788863781.545804:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298865792 00000100:00100000:0.0:1788863781.546220:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 214 00000100:00100000:0.0:1788863781.546234:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:11602:x1875759298865792:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788863781.546316:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788863781.546471:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:11602:x1875759298865792:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 240us (4674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863781.546481:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 214 00000100:00100000:0.0:1788863781.561943:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863781.562552:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298865920 00000100:00100000:2.0:1788863781.562584:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298865920 00000100:00100000:2.0:1788863781.562664:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 215 00000100:00100000:2.0:1788863781.562678:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:11602:x1875759298865920:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788863781.562836:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb9d0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.562914:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563377:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563399:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563408:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563414:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563445:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563454:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563461:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863781.563516:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788863781.563521:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863781.563557:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563569:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563576:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb9d0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563583:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563589:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863781.563594:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563601:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb9d0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563615:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bcb0f5900) 00010000:00010000:2.0:1788863781.563618:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863781.563624:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb9d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563631:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbb9d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563649:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563656:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9d7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563662:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563675:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863781.563678:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563685:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9d7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563707:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8e8bc9330100) 00010000:00010000:2.0:1788863781.563710:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863781.563713:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9d7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563720:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563744:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563762:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563768:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563774:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863781.563776:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563783:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563813:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:2.0:1788863781.563815:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863781.563819:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.563825:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863781.567332:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:11602:x1875759298865920:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 4644us (5390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863781.567350:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 215 00000100:00100000:1.0:1788863781.574617:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863781.574913:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298866176 00000100:00100000:2.0:1788863781.574936:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298866176 00000100:00100000:2.0:1788863781.575019:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:2.0:1788863781.575032:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+60:11602:x1875759298866176:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863781.575062:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863781.575094:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.575223:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.575240:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.575254:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863781.575266:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788863781.575406:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.575415:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.575423:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.575429:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863781.575434:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.575443:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.575457:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:2.0:1788863781.575460:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788863781.575466:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.575471:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbb9ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.575528:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9e5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311b8 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.575540:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bcb0f5900) 00010000:00010000:2.0:1788863781.575542:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788863781.575546:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311b8 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.575571:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555800, rc 0) 00000100:00100000:2.0:1788863781.575636:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:11602:x1875759298866176:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 607us (1033us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788863781.575644:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:1.0:1788863781.582985:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863781.583095:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298866304 00000100:00100000:2.0:1788863781.583106:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298866304 00000100:00100000:2.0:1788863781.583172:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 217 00000100:00100000:2.0:1788863781.583183:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:11602:x1875759298866304:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788863781.583221:0:6707:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788863781.583432:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:11602:x1875759298866304:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 250us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863781.583441:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 217 00000100:00100000:0.0:1788863781.594171:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863781.594477:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298866560 00000100:00100000:2.0:1788863781.594491:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298866560 00000100:00100000:2.0:1788863781.594574:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:2.0:1788863781.594586:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:11602:x1875759298866560:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863781.594613:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863781.594617:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788863781.594656:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16400/0x744cd7666bbbb98a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33119c expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.594689:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863781.594698:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863781.594719:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788863781.595462:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788863781.595688:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.595703:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.595713:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.595782:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbb9fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311bf expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.595801:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311bf expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.595809:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863781.595812:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863781.595815:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554600, rc 0) 00000100:00100000:2.0:1788863781.595921:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+62:11602:x1875759298866560:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1337us (1765us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788863781.595930:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:1.0:1788863781.601467:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863781.602397:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298866816 00000100:00100000:2.0:1788863781.602414:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298866816 00000100:00100000:2.0:1788863781.602501:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 219 00000100:00100000:2.0:1788863781.602512:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+62:11602:x1875759298866816:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788863781.602590:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863781.602640:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311bf expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.602667:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863781.602684:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863781.603172:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbba0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.603189:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbba0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.603199:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbba0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.603217:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbba16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd66c1fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.603225:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbba16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd66c1fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.603231:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbba16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd66c1fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.603639:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbba0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.603649:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbba0f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.603656:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbba0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.603661:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863781.603675:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbba0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.603683:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbba0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.605844:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863781.606135:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863781.606146:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbba0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.606159:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555800/0x744cd7666bbbba0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.606191:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbba16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd66c1fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.606198:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbba16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd66c1fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.606205:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbba16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd66c1fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.606212:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863781.606217:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbba16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd66c1fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.606225:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbba16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd66c1fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.606236:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd66c1fc0 (ffff8e8bc9330b00) 00010000:00010000:2.0:1788863781.606238:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863781.606269:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbba16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd66c1fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.606275:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555000/0x744cd7666bbbba16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd66c1fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863781.606828:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:11602:x1875759298866816:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 4307us (5383us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863781.606840:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 219 00000100:00100000:3.0:1788863781.616835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863781.617906:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298866944 00000100:00100000:2.0:1788863781.617929:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298866944 00000100:00100000:2.0:1788863781.618017:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00100000:2.0:1788863781.618029:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+61:11602:x1875759298866944:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863781.618056:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863781.618297:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311c6 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.618338:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.618354:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.618369:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.618500:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311c6 expref: 63 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.618524:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311c6 expref: 62 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.618547:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863781.618550:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788863781.618554:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554a00, rc 0) 00000100:00100000:2.0:1788863781.618644:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+62:11602:x1875759298866944:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 617us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863781.618653:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00100000:3.0:1788863781.629558:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863781.630023:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298867200 00000100:00100000:0.0:1788863781.630036:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298867200 00000100:00100000:0.0:1788863781.630134:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 221 00000100:00100000:0.0:1788863781.630146:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+62:11602:x1875759298867200:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788863781.630249:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbba2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.630270:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbba2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.630284:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbba2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788863781.630578:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788863781.630591:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410759737881ns, next at 411759734463ns, rc = 0 00000004:00010000:0.0:1788863781.630708:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f9a18e2 reply state 00000000522d8dfa transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbba2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863781.630718:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863781.630891:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+64:11602:x1875759298867200:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 745us (3210us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788863781.630898:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 221 00010000:00010000:2.0:1788863781.640517:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbba2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.640539:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbba2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.640547:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbba2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.640554:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863781.640559:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbba2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.640568:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbba2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.640589:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863781.640593:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788863781.640599:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbba2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.640606:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a400/0x744cd7666bbbba2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863781.641722:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863781.643403:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298867328 00000100:00100000:2.0:1788863781.643424:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298867328 00000100:00100000:2.0:1788863781.643530:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 222 00000100:00100000:2.0:1788863781.643545:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+63:11602:x1875759298867328:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863781.643589:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863781.643626:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.643826:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311cd expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.643939:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311cd expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.643971:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863781.643975:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863781.643980:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554600, rc 0) 00000100:00100000:2.0:1788863781.644784:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+64:11602:x1875759298867328:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 532us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863781.644793:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 222 00000100:00100000:1.0:1788863781.655505:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863781.655632:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298867456 00000100:00100000:3.0:1788863781.655662:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298867456 00000100:00100000:3.0:1788863781.655957:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:3.0:1788863781.655985:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2351:x1875759298867456:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788863781.656610:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:2351:x1875759298867456:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 628us (1125us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788863781.656631:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00080000:1.0:1788863781.657305:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863781.661242:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863781.663732:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298867712 00000100:00100000:0.0:1788863781.663766:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298867712 00000100:00100000:0.0:1788863781.664054:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:0.0:1788863781.664193:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+64:11602:x1875759298867712:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788863781.664620:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+65:11602:x1875759298867712:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 553us (3391us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788863781.664630:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:0.0:1788863781.675561:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863781.675828:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298867968 00000100:00100000:3.0:1788863781.675843:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298867968 00000100:00100000:3.0:1788863781.675948:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 223 00000100:00100000:3.0:1788863781.675963:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+65:11602:x1875759298867968:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788863781.676411:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+65:11602:x1875759298867968:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 450us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863781.676419:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 223 00000100:00100000:1.0:1788863781.689170:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863781.690308:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298868096 00000100:00100000:3.0:1788863781.690337:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298868096 00000100:00100000:3.0:1788863781.690443:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:3.0:1788863781.690474:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+65:11602:x1875759298868096:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863781.690503:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863781.690529:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbba39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311d4 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.690617:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbba40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.690633:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbba40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.690646:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbba40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863781.690689:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863781.690955:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbba40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.690988:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17600/0x744cd7666bbbba39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311d4 expref: 67 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.691008:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbba40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311d4 expref: 66 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.691018:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:3.0:1788863781.691021:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788863781.691025:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16e00, rc 0) 00000100:00100000:3.0:1788863781.691116:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+66:11602:x1875759298868096:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 645us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863781.691998:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:1.0:1788863781.695401:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863781.695818:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298868224 00000100:00100000:0.0:1788863781.695829:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298868224 00000100:00100000:0.0:1788863781.695955:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:0.0:1788863781.695968:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+10:2350:x1875759298868224:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863781.695987:0:10277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863781.696009:0:10277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad6c8c47/0x744cd7666bbbba47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311db expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863781.696034:0:10277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe524, blocks: 0x1 00010000:00010000:0.0:1788863781.696055:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1788863781.696059:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863781.696271:0:10277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad6c8c47/0x744cd7666bbbba47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311db expref: 11 pid: 10277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.696299:0:10277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad6c8c47/0x744cd7666bbbba47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311db expref: 11 pid: 10277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.696312:0:10277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18b000, rc 0) 00000100:00100000:0.0:1788863781.696434:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+11:2350:x1875759298868224:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 468us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863781.696442:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:0.0:1788863781.706661:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863781.706827:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298868480 00000100:00100000:2.0:1788863781.706845:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298868480 00000100:00100000:2.0:1788863781.706999:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 225 00000100:00100000:2.0:1788863781.707011:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+66:11602:x1875759298868480:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788863781.707198:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+66:11602:x1875759298868480:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 188us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863781.707223:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 225 00000100:00100000:0.0:1788863781.711119:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863781.711270:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298868608 00000100:00100000:3.0:1788863781.711281:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298868608 00000100:00100000:3.0:1788863781.711342:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:3.0:1788863781.711353:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+11:11602:x1875759298868608:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863781.711370:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863781.711391:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311e2 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.711425:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad6c8c47/0x744cd7666bbbba47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311db expref: 12 pid: 10277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.711435:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863781.711440:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863781.711445:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e2 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.711481:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad6c8c47/0x744cd7666bbbba47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311db expref: 12 pid: 10277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.711495:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad6c8c47/0x744cd7666bbbba47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311db expref: 12 pid: 10277 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863781.711508:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6680:1875759324018048:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788863781.711611:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8be1ed4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788863781.719545:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863781.720173:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee497100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6680:1875759324018048:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788863781.720212:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e2 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.720237:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17600, rc 0) 00000100:00100000:3.0:1788863781.720310:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+12:11602:x1875759298868608:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 8958us (9200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863781.720328:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:0.0:1788863781.720519:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298868736 00000100:00100000:0.0:1788863781.720528:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298868736 00010000:00010000:0.0:1788863781.720568:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad6c8c47/0x744cd7666bbbba47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311db expref: 12 pid: 10277 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863781.720620:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:0.0:1788863781.720629:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc66fa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+12:2350:x1875759298868736:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863781.720644:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863781.720669:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad6c8c47/0x744cd7666bbbba47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311db expref: 12 pid: 10277 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.720683:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad6c8c47/0x744cd7666bbbba47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311db expref: 12 pid: 10277 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.720943:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad6c8c47/0x744cd7666bbbba47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311db expref: 12 pid: 10277 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.720964:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863781.720969:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863781.720977:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e2 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.720988:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e2 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.721028:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e2 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863781.721042:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee336d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875759324018176:192.168.204.51@tcp:105: 00000100:00100000:0.0:1788863781.721116:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788863781.729347:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863781.729542:0:6683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298868864 00000100:00100000:0.0:1788863781.729556:0:6683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298868864 00002000:00100000:0.0:1788863781.729639:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8e8bee497100 x1875759298868864/t0(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:12/0 lens 504/0 e 0 to 0 dl 1788863792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863781.729651:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bee497100 with x1875759298868864 ext(0->12) 00002000:00010000:0.0:1788863781.729660:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bee497100 00000100:00100000:0.0:1788863781.729702:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1788863781.729722:0:6683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+12:2350:x1875759298868864:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788863781.730529:0:6683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:2350:x1875759298868864:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 603us (998us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788863781.730538:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00002000:00100000:0.0:1788863781.730547:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8e8bee497100 x1875759298868864/t4294967320(0) o4->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:12/0 lens 504/448 e 0 to 0 dl 1788863792 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788863781.730555:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bee497100 with x1875759298868864 ext(0->12) 00002000:00010000:0.0:1788863781.730559:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bee497100 00000100:00100000:1.0:1788863781.731118:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee336d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875759324018176:192.168.204.51@tcp:105: 00010000:00010000:1.0:1788863781.731162:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863781.731203:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc66fa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:2350:x1875759298868736:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 10574us (11668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863781.731211:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:3.0:1788863781.736638:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863781.736824:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298868992 00000100:00100000:2.0:1788863781.736835:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298868992 00000100:00100000:2.0:1788863781.736936:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:2.0:1788863781.736948:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+66:11602:x1875759298868992:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788863781.839878:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788863781.839899:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788863781.839975:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8bcb020600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788863781.839981:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bff6e0900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bcb020cc0 00000020:00080000:1.0:1788863781.839985:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bff6e0100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bff13ac00 00000020:00080000:1.0:1788863781.840010:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 4 00000020:00080000:1.0:1788863781.840435:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:1.0:1788863781.840627:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:2.0:1788863781.844439:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+49:11602:x1875759298868992:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 107473us (107792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863781.844458:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:3.0:1788863781.846200:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb95c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324018432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788863781.846288:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863781.846382:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863781.846389:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb95ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324018304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788863781.846416:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863781.847542:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324018432 00000100:00100000:2.0:1788863781.847558:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324018432 00000100:00100000:2.0:1788863781.847651:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324018304 00000100:00100000:2.0:1788863781.847655:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324018304 00000100:00100000:2.0:1788863781.847677:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788863781.847686:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1875759324018432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788863781.847938:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788863781.847942:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788863780 00002000:00010000:2.0:1788863781.847945:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788863781.847947:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788863780 -> 1788863780 00002000:00010000:2.0:1788863781.847950:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788863781.848019:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1875759324018432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 333us (1730us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788863781.848027:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788863781.848046:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788863781.848052:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf441e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1875759324018304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788863781.848074:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1788863781.848123:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.848156:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001054624d/0x744cd7666bbbb817 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331141 expref: 12 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.848167:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788863781.848172:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863781.848177:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.848212:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001054624d/0x744cd7666bbbb817 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331141 expref: 12 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.848229:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001054624d/0x744cd7666bbbb817 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331141 expref: 12 pid: 12016 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863781.848243:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6679:1875759324018560:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863781.848325:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf0c70c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788863781.848502:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8bfb95c000/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788863781.848509:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb95c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324018432:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788863781.855696:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863781.856908:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863781.856937:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863781.856972:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298869248 00000100:00100000:3.0:1788863781.856984:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298869248 00000100:00100000:3.0:1788863781.857039:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:3.0:1788863781.857049:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+13:2351:x1875759298869248:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788863781.857653:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298869120 00000100:00100000:2.0:1788863781.857660:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298869120 00010000:00010000:2.0:1788863781.857690:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001054624d/0x744cd7666bbbb817 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331141 expref: 14 pid: 12016 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863781.857824:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:2.0:1788863781.857877:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:2351:x1875759298869120:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863781.857893:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863781.857901:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001054624d/0x744cd7666bbbb817 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331141 expref: 14 pid: 12016 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.857917:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001054624d/0x744cd7666bbbb817 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331141 expref: 14 pid: 12016 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.857947:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863781.857952:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863781.857959:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.857970:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.857991:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863781.858047:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+14:2351:x1875759298869120:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 197us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863781.858055:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:0.0:1788863781.858685:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:1.0:1788863781.860211:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8bc8a2de40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788863781.860223:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bd2933b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bc8a2d300 00000020:00080000:1.0:1788863781.860259:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bd2933c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bffdca400 00000020:00080000:1.0:1788863781.860285:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:2.0:1788863781.860508:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863781.860939:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324018688:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788863781.861032:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788863781.861295:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788863781.861567:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788863781.861657:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788863781.862281:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324018688 00000100:00100000:0.0:1788863781.862296:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324018688 00000100:00100000:0.0:1788863781.862965:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788863781.862978:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875759324018688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788863781.863024:0:10277:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1788863781.863070:0:10277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9fe522, atime: 0x6a9fe523, ctime: 0x6a9fe522, blocks: 0x1 00010000:00010000:0.0:1788863781.863103:0:10277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbba5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.863123:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1788863781.863127:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00000100:00080000:3.0:1788863781.863236:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788863781.863575:0:10277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbba5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.863596:0:10277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbba5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.863607:0:10277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbba5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.863615:0:10277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbba5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.863677:0:10277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788863781.865602:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875759324018688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2618us (4561us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788863781.865617:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:0.0:1788863781.866541:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8bee334700/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788863781.866552:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324018688:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788863781.866595:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001054624d/0x744cd7666bbbb817 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331141 expref: 13 pid: 12016 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863781.866613:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6679:1875759324018560:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863781.866645:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.866657:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.866664:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.866676:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.866684:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.877580:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863781.877596:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbba5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.877611:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863781.877617:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbba5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.877650:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbba5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.877675:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbba5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.877684:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbba5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.877815:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863781.877820:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.877827:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863781.877830:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.877837:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.877880:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.877890:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863781.877891:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863781.877899:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863781.882582:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788863781.882601:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076bdf2fd/0x744cd7666bbbba55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.882830:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863781.884603:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf441e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1875759324018304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36542us (38176us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788863781.884616:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1788863781.886609:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8bfb95ca80/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788863781.886624:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb95ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324018304:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788863781.943982:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1788863781.944003:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1788863781.944010:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1788863781.944211:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298869248:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 87154us (87263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863781.944247:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:2.0:1788863781.948911:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863781.949002:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298869504 00000100:00100000:1.0:1788863781.949015:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298869504 00000100:00100000:1.0:1788863781.949104:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 227 00000100:00100000:1.0:1788863781.949117:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:11602:x1875759298869504:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788863781.949192:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863781.949233:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16e00/0x744cd7666bbbba40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311d4 expref: 20 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.949264:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:1.0:1788863781.949273:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863781.949578:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbba63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.949669:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbba63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.949685:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbba63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863781.952762:0:9496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ee9d144 reply state 00000000d48858dd transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbba63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863781.953542:0:9496:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788863781.954533:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:11602:x1875759298869504:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 5403us (5626us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788863781.954550:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 227 00010000:00010000:3.0:1788863781.964061:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbba63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.964104:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbba63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.964146:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbba63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.964151:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ba00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863781.964158:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbba63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.964167:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbba63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.964189:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:3.0:1788863781.964194:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863781.964202:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbba63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863781.964210:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbba63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863781.966576:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863781.966848:0:12016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298869632 00000100:00100000:0.0:1788863781.966912:0:12016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298869632 00000100:00100000:0.0:1788863781.966986:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:0.0:1788863781.966997:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2350:x1875759298869632:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788863781.967342:0:12016:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788863781.967347:0:12016:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788863780 -> 1788863779 00002000:00010000:0.0:1788863781.967349:0:12016:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788863779 00002000:00010000:0.0:1788863781.967352:0:12016:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788863780 -> 1788863779 00002000:00010000:0.0:1788863781.967355:0:12016:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788863781.967438:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298869632:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 442us (881us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788863781.967448:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:1.0:1788863781.972722:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863781.973013:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298869888 00000100:00100000:0.0:1788863781.973030:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298869888 00000100:00100000:0.0:1788863781.973111:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:0.0:1788863781.973122:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:11602:x1875759298869888:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788863781.973223:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.973246:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311c6 expref: 20 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.973259:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.973302:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311c6 expref: 20 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.973319:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311c6 expref: 20 pid: 6707 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863781.973368:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875759324018816:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863781.973485:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863781.980193:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863781.980560:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875759324018816:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863781.980601:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863781.980990:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298870016 00000100:00100000:2.0:1788863781.981000:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298870016 00010000:00010000:2.0:1788863781.981048:0:8500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311c6 expref: 21 pid: 6707 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863781.981252:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:2.0:1788863781.981263:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:2351:x1875759298870016:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863781.981281:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863781.981288:0:8500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311c6 expref: 21 pid: 6707 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.981302:0:8500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311c6 expref: 21 pid: 6707 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.981466:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311c6 expref: 21 pid: 6707 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.981491:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863781.981497:0:8500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.981509:0:8500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.981537:0:8500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863781.981618:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863781.981695:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:2351:x1875759298870016:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 433us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863781.981922:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00010000:00010000:0.0:1788863781.985612:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.985631:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.986074:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.986295:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.986302:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.986309:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863781.986385:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.986395:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.986416:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:1.0:1788863781.986419:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788863781.986424:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863781.986430:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b400/0x744cd7666bbbba6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863781.986660:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:11602:x1875759298869888:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 13473us (13902us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788863781.986672:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:2.0:1788863781.994010:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863781.994215:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298870144 00000100:00100000:0.0:1788863781.994225:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298870144 00000100:00100000:0.0:1788863781.994332:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:0.0:1788863781.994343:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2351:x1875759298870144:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788863781.994392:0:10277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.994415:0:10277:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e2 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.994424:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788863781.994429:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863781.994434:0:10277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.994492:0:10277:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e2 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863781.994506:0:10277:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e2 expref: 8 pid: 6680 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863781.994521:0:10277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10277:1875759324018944:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863781.994626:0:10277:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863782.000037:0:10277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10277:1875759324018944:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863782.000095:0:10277:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863782.004271:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863782.004624:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298870272 00000100:00100000:0.0:1788863782.004638:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298870272 00010000:00010000:0.0:1788863782.004691:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e2 expref: 9 pid: 6680 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863782.004760:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:0.0:1788863782.004771:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+9:2351:x1875759298870272:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863782.004791:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863782.004822:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e2 expref: 9 pid: 6680 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.004837:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e2 expref: 9 pid: 6680 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.004926:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000542b7bda/0x744cd7666bbbba4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e2 expref: 9 pid: 6680 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.004949:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863782.004953:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788863782.004961:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.004971:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.005002:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863782.005061:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2351:x1875759298870272:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 290us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863782.005069:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00010000:00010000:1.0:1788863782.008805:0:10277:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.008880:0:10277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.008925:0:10277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.008935:0:10277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.008944:0:10277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.008952:0:10277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18ac00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863782.008957:0:10277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.008966:0:10277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.008987:0:10277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.008995:0:10277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c40eec67/0x744cd7666bbbba71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863782.009109:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298870144:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 14763us (15104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863782.009118:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:1.0:1788863782.023057:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863782.024758:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298870528 00000100:00100000:2.0:1788863782.024772:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298870528 00000100:00080000:3.0:1788863782.024846:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863782.025127:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 229 00000100:00100000:2.0:1788863782.025139:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:11602:x1875759298870528:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788863782.025229:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.025251:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.025264:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.025664:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.025677:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311cd expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.025686:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.025763:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311cd expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.025781:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311cd expref: 20 pid: 5842 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863782.025800:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324019072:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863782.026317:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf0c79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863782.032310:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863782.032439:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298870656 00000100:00100000:0.0:1788863782.032451:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298870656 00010000:00010000:0.0:1788863782.032505:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba32 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311cd expref: 21 pid: 5842 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863782.032565:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:0.0:1788863782.032578:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:2350:x1875759298870656:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863782.032608:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863782.032616:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba32 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311cd expref: 21 pid: 5842 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863782.032647:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324019072:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863782.032656:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311cd expref: 21 pid: 5842 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.032686:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554600/0x744cd7666bbbba32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311cd expref: 21 pid: 5842 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.032750:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.033634:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:0.0:1788863782.033643:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.033656:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.033664:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.033710:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863782.034030:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:2350:x1875759298870656:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1296us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863782.034040:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00010000:00010000:2.0:1788863782.034124:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.034132:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788863782.034363:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788863782.034533:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788863782.034583:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788863782.034688:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875759324019200:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788863782.034765:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863782.034807:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcf0c7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863782.035338:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324019200 00000100:00100000:0.0:1788863782.035348:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324019200 00000100:00100000:0.0:1788863782.035415:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863782.035425:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875759324019200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788863782.035516:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875759324019200:12345-0@lo:1000:mdt00_001.0 Request processed in 92us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863782.035523:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863782.035650:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1788863782.035656:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1788863782.035675:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8bfb95c000, transno 4294967321 00000100:00100000:2.0:1788863782.035705:0:5841:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e8bfb95ca80 x1875759324018304/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788863797 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863782.035719:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875759324019200:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788863782.040612:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788863782.040720:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875759324019328:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788863782.040819:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863782.041040:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863782.041110:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324019328 00000100:00100000:2.0:1788863782.041118:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324019328 00000100:00100000:2.0:1788863782.041165:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788863782.041174:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875759324019328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788863782.041465:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5841:x1875759324019328:12345-0@lo:1000:mdt00_001.0 Request processed in 291us (645us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788863782.041473:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863782.041553:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875759324019328:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788863782.041595:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041607:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041615:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041633:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863782.041637:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041646:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041664:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:0.0:1788863782.041667:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863782.041672:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041679:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554c00/0x744cd7666bbbba7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041715:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041752:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041757:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041763:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863782.041767:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041773:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041783:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:0.0:1788863782.041786:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863782.041793:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb9c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311b1 expref: 23 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041807:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb9c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311b1 expref: 23 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041817:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb9c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311b1 expref: 23 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.041966:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb9c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311b1 expref: 23 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863782.041982:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd23c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324019456:192.168.204.51@tcp:105: 00000100:00100000:0.0:1788863782.042054:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788863782.049549:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863782.049829:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd23c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875759324019456:192.168.204.51@tcp:105: 00010000:00010000:3.0:1788863782.050010:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863782.050023:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbb9c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050118:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbba86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050146:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbba86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863782.050150:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298870784 00000100:00100000:2.0:1788863782.050159:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298870784 00010000:00010000:0.0:1788863782.050161:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbba86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050172:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbba86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050179:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbba86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050184:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbba86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050190:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18be00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863782.050193:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbba86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050200:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbba86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050212:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:0.0:1788863782.050215:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863782.050219:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbba86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050225:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18be00/0x744cd7666bbbba86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050251:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863782.050255:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00010000:00010000:0.0:1788863782.050257:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050264:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863782.050265:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:11600:x1875759298870784:12345-192.168.204.51@tcp:49:lfs.0 00010000:00010000:0.0:1788863782.050269:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863782.050272:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050277:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050284:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:0.0:1788863782.050287:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863782.050289:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.050295:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554a00/0x744cd7666bbbba78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863782.050411:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+24:11600:x1875759298870784:12345-192.168.204.51@tcp:49:lfs.0 Request processed in 146us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863782.050419:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:0.0:1788863782.050521:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:11602:x1875759298870528:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 25385us (27476us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788863782.050529:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 229 00000020:00080000:0.0:1788863782.050533:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788863782.050593:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788863782.050598:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863782.051297:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788863782.051319:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788863782.056777:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863782.056933:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298871040 00000100:00100000:3.0:1788863782.056946:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298871040 00000100:00100000:3.0:1788863782.057025:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 230 00000100:00100000:3.0:1788863782.057036:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:11600:x1875759298871040:12345-192.168.204.51@tcp:58:lfs.0 00000040:00080000:2.0:1788863782.060201:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788863782.060761:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:11600:x1875759298871040:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 3701us (3969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863782.060776:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 230 00000100:00100000:0.0:1788863782.061015:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863782.061571:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298871296 00000100:00100000:1.0:1788863782.061582:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298871296 00000100:00100000:1.0:1788863782.061693:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:1.0:1788863782.061704:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc2e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+23:11602:x1875759298871296:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788863782.062847:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788863782.062995:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1788863782.063051:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbba8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.063069:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbba8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.064436:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbba8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.064454:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbba8d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.064461:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbba8d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.064468:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbba8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863782.068015:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788863782.068171:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc2e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+25:11602:x1875759298871296:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 6463us (7151us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788863782.068182:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000020:00080000:0.0:1788863782.068188:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788863782.068296:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863782.068304:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbba8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.068313:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863782.068317:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbba8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.068399:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbba8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.068416:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8bd20dd900) 00010000:00010000:2.0:1788863782.068419:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788863782.068424:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbba8d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.068430:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbba8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.068448:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863782.068450:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863782.068452:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863782.126517:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863782.126708:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298871424 00000100:00100000:1.0:1788863782.126720:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298871424 00000100:00100000:1.0:1788863782.126815:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 231 00000100:00100000:1.0:1788863782.126827:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+25:11604:x1875759298871424:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863782.127050:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863782.127237:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbba94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311e9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.127397:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbba9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.127418:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbba9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.127431:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbba9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.127451:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbbaa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.127457:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbbaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.127463:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbbaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.129429:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbbaa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.129465:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311aa expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.129497:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbbaa9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.129565:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311aa expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.129589:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311aa expref: 26 pid: 5840 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863782.129611:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffce0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875759324019584:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863782.130384:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc8a2da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863782.134535:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863782.135036:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298871680 00000100:00100000:0.0:1788863782.135048:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298871680 00000100:00100000:0.0:1788863782.135130:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:0.0:1788863782.135140:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:5593:x1875759298871680:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788863782.135425:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+28:5593:x1875759298871680:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 285us (909us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788863782.135434:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:2.0:1788863782.135806:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffce0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875759324019584:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863782.135835:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbbaa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863782.139547:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863782.139725:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298871808 00000100:00100000:2.0:1788863782.139745:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298871808 00010000:00010000:2.0:1788863782.139788:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311aa expref: 28 pid: 5840 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863782.139829:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:2.0:1788863782.139840:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+28:2351:x1875759298871808:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863782.140032:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863782.140041:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311aa expref: 28 pid: 5840 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.140075:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311aa expref: 28 pid: 5840 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.140248:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbb9b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311aa expref: 28 pid: 5840 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.140267:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:2.0:1788863782.140274:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbbaa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.140287:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbbaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.140296:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbbaa9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863782.140466:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863782.140551:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:2351:x1875759298871808:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 711us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863782.140559:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00010000:00010000:1.0:1788863782.142569:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbbaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.142589:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbbaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863782.142657:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788863782.142663:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788863782.142693:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbbaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.142711:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbbaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.142723:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbba9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.142774:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbba9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.142781:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbba9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.142788:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863782.142792:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbba9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.142800:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbba9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.142817:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:1.0:1788863782.142820:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863782.142825:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbba9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.142831:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbba9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.142990:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbbaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.142997:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbbaa2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.143003:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbbaa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.143008:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863782.143018:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbbaa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.143023:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbbaa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.143033:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8bd20ddf00) 00010000:00010000:1.0:1788863782.143035:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863782.143038:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbbaa2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.143043:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b400/0x744cd7666bbbbaa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.143306:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a200/0x744cd7666bbbba94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e9 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.143407:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbbaa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e9 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863782.143415:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:1.0:1788863782.143418:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863782.143422:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b800, rc 0) 00000100:00100000:1.0:1788863782.143602:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+26:11604:x1875759298871424:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 16774us (17098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863782.143611:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 231 00010000:00010000:1.0:1788863782.871350:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863782.998433:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324019840:0@lo:400:kworker.0 00000100:00100000:2.0:1788863782.998532:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863782.998594:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324020352:0@lo:400:kworker.0 00000100:00100000:2.0:1788863782.998620:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863782.998656:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863782.998662:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324019968:0@lo:400:kworker.0 00000100:00100000:2.0:1788863782.998686:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863782.998750:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324020352 00000100:00100000:2.0:1788863782.998758:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324020352 00000100:00100000:2.0:1788863782.998807:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788863782.998815:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875759324020352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863782.998895:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875759324020352:12345-0@lo:400:kworker.0 Request processed in 79us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863782.998902:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788863782.998925:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324019840 00000100:00100000:2.0:1788863782.998938:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324019840 00000100:00100000:2.0:1788863782.998972:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324019968 00000100:00100000:2.0:1788863782.998975:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324019968 00000100:00100000:2.0:1788863782.999011:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788863782.999021:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324019840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863782.999063:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324019840:12345-0@lo:400:kworker.0 Request processed in 46us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863782.999069:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788863782.999088:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788863782.999094:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324019968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863782.999120:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324019968:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863782.999125:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788863782.999168:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324019968:0@lo:400:kworker.0 00000100:00100000:2.0:1788863782.999184:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324019840:0@lo:400:kworker.0 00000100:00100000:2.0:1788863782.999197:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324020352:0@lo:400:kworker.0 00000100:00100000:0.0:1788863782.999546:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759324019712:0@lo:400:kworker.0 00000100:00100000:0.0:1788863782.999607:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863782.999653:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324020224:0@lo:400:kworker.0 00000100:00100000:0.0:1788863782.999692:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863782.999735:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863782.999743:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324020096:0@lo:400:kworker.0 00000100:00100000:0.0:1788863782.999768:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863782.999797:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324020224 00000100:00100000:0.0:1788863782.999802:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324020224 00000100:00100000:0.0:1788863782.999832:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788863782.999870:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324020224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863782.999910:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324020224:12345-0@lo:400:kworker.0 Request processed in 65us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863782.999916:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788863782.999945:0:12016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324020096 00000100:00100000:0.0:1788863782.999965:0:12016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324020096 00000100:00100000:0.0:1788863783.000005:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788863783.000012:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3307:x1875759324020096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863783.000058:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3307:x1875759324020096:12345-0@lo:400:kworker.0 Request processed in 43us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863783.000076:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788863783.000154:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324020096:0@lo:400:kworker.0 00000100:00100000:0.0:1788863783.000164:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324020224:0@lo:400:kworker.0 00000100:00080000:3.0:1788863783.001907:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863783.002031:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324020480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863783.002116:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863783.002305:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324020480 00000100:00100000:0.0:1788863783.002314:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324020480 00000100:00100000:2.0:1788863783.002378:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324019712 00000100:00100000:0.0:1788863783.002382:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788863783.002395:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324019712 00000100:00100000:0.0:1788863783.002401:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875759324020480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788863783.002440:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863783.002452:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788863783.002459:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759324019712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863783.002490:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875759324020480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863783.002497:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759324019712:12345-0@lo:400:kworker.0 Request processed in 40us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863783.002497:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788863783.002502:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788863783.002556:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759324019712:0@lo:400:kworker.0 00000100:00080000:3.0:1788863783.004442:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863783.004532:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324020480:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788863783.064685:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863783.064698:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863783.065487:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788863783.065500:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788863783.065666:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875759324020608:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788863783.066226:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc7345d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863783.072078:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863783.072223:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298871936 00000100:00100000:2.0:1788863783.072234:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298871936 00000100:00100000:2.0:1788863783.072301:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 232 00000100:00100000:2.0:1788863783.072311:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:11615:x1875759298871936:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788863783.072351:0:9496:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788863783.072499:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+27:11615:x1875759298871936:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 189us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863783.072508:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 232 00000100:00100000:0.0:1788863783.073983:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bd5772680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875759324020608:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788863783.088714:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863783.090435:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298872192 00000100:00100000:0.0:1788863783.090451:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298872192 00000100:00100000:0.0:1788863783.090525:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 233 00000100:00100000:0.0:1788863783.090560:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+26:11615:x1875759298872192:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863783.090591:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863783.090614:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbab0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.090715:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.090739:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.090942:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863783.090955:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788863783.091092:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbab0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311f0 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.091111:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311f0 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.091120:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:0.0:1788863783.091123:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788863783.091127:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18a800, rc 0) 00000100:00100000:0.0:1788863783.091203:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+28:11615:x1875759298872192:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 646us (2502us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788863783.091210:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 233 00000100:00100000:2.0:1788863783.109969:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863783.110066:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863783.112547:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298872448 00000100:00100000:0.0:1788863783.112567:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298872448 00000100:00100000:0.0:1788863783.112657:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 234 00000100:00100000:0.0:1788863783.112669:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+28:11615:x1875759298872448:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788863783.112778:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbac5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.112797:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.112809:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.113105:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.113115:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbac5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.113123:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbac5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.113129:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863783.113134:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbac5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.113142:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbac5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.113154:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:0.0:1788863783.113157:0:6707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788863783.113163:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbac5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.113179:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbac5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863783.113351:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:11615:x1875759298872448:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 683us (3392us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788863783.113360:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 234 00000040:00080000:2.0:1788863783.116414:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788863783.116424:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788863783.120103:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788863783.120132:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788863783.122247:0:8500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298872576 00000100:00100000:1.0:1788863783.122263:0:8500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298872576 00000100:00100000:0.0:1788863783.123213:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:0.0:1788863783.123227:0:8500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:2351:x1875759298872576:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863783.123243:0:8500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863783.123268:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbab7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311f0 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.123286:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:0.0:1788863783.123291:0:8500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863783.123352:0:8500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+28:2351:x1875759298872576:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 128us (13290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863783.123359:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1788863783.125145:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863783.125262:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298872832 00000100:00100000:3.0:1788863783.125271:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298872832 00000100:00100000:3.0:1788863783.125331:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:3.0:1788863783.125340:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+28:11615:x1875759298872832:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788863783.133796:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:11615:x1875759298872832:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 8434us (8639us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788863783.133823:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000040:00080000:1.0:1788863783.170389:0:12511:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788863783.170399:0:12511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788863783.170447:0:12511:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788863783.170456:0:12511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788863783.508842:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863783.509341:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298873088 00000100:00100000:0.0:1788863783.509352:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298873088 00000100:00100000:0.0:1788863783.509418:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 235 00000100:00100000:0.0:1788863783.509429:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+29:11628:x1875759298873088:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863783.509464:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863783.509488:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbacc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.509632:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbad3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.509649:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbad3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.509661:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbad3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863783.509673:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788863783.510437:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbacc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311f7 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.510458:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311f7 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.510467:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:0.0:1788863783.510470:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788863783.510475:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18a000, rc 0) 00000100:00100000:0.0:1788863783.510583:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+31:11628:x1875759298873088:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1154us (1751us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788863783.510592:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 235 00000100:00100000:1.0:1788863783.522677:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863783.524823:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298873216 00000100:00100000:0.0:1788863783.524837:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298873216 00000100:00100000:0.0:1788863783.524919:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 236 00000100:00100000:0.0:1788863783.524930:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+31:11628:x1875759298873216:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1788863783.525011:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbae1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.525035:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.525048:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.525086:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.525094:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbae1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.525109:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.525116:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863783.525121:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.525129:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbae1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.525141:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:0.0:1788863783.525144:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863783.525150:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbae1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.525157:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a800/0x744cd7666bbbbae1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863783.525234:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+31:11628:x1875759298873216:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 305us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863783.525247:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 236 00000100:00100000:1.0:1788863783.650009:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863783.650136:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298873344 00000100:00100000:0.0:1788863783.650148:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298873344 00000100:00100000:0.0:1788863783.650239:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:0.0:1788863783.650249:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2352:x1875759298873344:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:0.0:1788863783.650267:0:10277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863783.650287:0:10277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000974e1151/0x744cd7666bbbbae8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3311fe expref: -99 pid: 10277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863783.650314:0:10277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9fe523, atime: 0x6a9fe523, ctime: 0x6a9fe523, blocks: 0xb 00010000:00010000:0.0:1788863783.650335:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788863783.650340:0:10277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863783.650348:0:10277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000974e1151/0x744cd7666bbbbae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311fe expref: 8 pid: 10277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.650367:0:10277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000974e1151/0x744cd7666bbbbae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311fe expref: 8 pid: 10277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863783.650380:0:10277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18a800, rc 0) 00000100:00100000:0.0:1788863783.650439:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2352:x1875759298873344:12345-192.168.204.51@tcp:101:cat.0 Request processed in 191us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863783.650446:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00080000:3.0:1788863783.651016:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863783.659550:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863783.659664:0:6684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298873472 00000100:00100000:1.0:1788863783.659675:0:6684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298873472 00002000:00100000:1.0:1788863783.659746:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8e8bd5772680 x1875759298873472/t0(0) o3->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:14/0 lens 488/0 e 0 to 0 dl 1788863794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788863783.659759:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bd5772680 with x1875759298873472 ext(0->4095) 00002000:00010000:1.0:1788863783.659765:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bd5772680 00000100:00100000:1.0:1788863783.659802:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1788863783.659813:0:6684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd5772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298873472:12345-192.168.204.51@tcp:3:cat.0 00000100:00100000:1.0:1788863783.661305:0:6684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd5772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2350:x1875759298873472:12345-192.168.204.51@tcp:3:cat.0 Request processed in 1484us (1755us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788863783.661319:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00002000:00100000:1.0:1788863783.661331:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8e8bd5772680 x1875759298873472/t0(0) o3->6fd3bcef-c680-4c25-aae1-ecd03903ad0a@192.168.204.51@tcp:14/0 lens 488/4536 e 0 to 0 dl 1788863794 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788863783.661341:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8bd5772680 with x1875759298873472 ext(0->4095) 00002000:00010000:1.0:1788863783.661346:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e8bd5772680 00010000:00010000:1.0:1788863783.894309:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788863784.139684:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788863784.139753:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1788863784.766190:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863784.766232:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863784.766279:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863784.766318:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863784.766346:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863784.766381:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298874112 00000100:00100000:1.0:1788863784.766392:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298874112 00000100:00100000:1.0:1788863784.766466:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298873728 00000100:00100000:1.0:1788863784.766469:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298873728 00000100:00100000:1.0:1788863784.766496:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:1.0:1788863784.766507:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298874112:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863784.766587:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298874112:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863784.766595:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:1.0:1788863784.766614:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:1.0:1788863784.766621:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+31:2351:x1875759298873728:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863784.766649:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+31:2351:x1875759298873728:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 29us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863784.766656:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:1.0:1788863784.766674:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298873856 00000100:00100000:1.0:1788863784.766677:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298873856 00000100:00100000:1.0:1788863784.766718:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298873984 00000100:00100000:1.0:1788863784.766721:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298873984 00000100:00100000:1.0:1788863784.766738:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:1.0:1788863784.766744:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298873856:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863784.766784:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298873856:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 40us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863784.766805:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:1.0:1788863784.766817:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:1.0:1788863784.766822:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2351:x1875759298873984:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863784.766848:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+8:2351:x1875759298873984:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863784.766889:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00080000:1.0:1788863784.766907:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863784.766913:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863784.767156:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298873600 00000100:00100000:2.0:1788863784.767162:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298873600 00000100:00100000:2.0:1788863784.767201:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 300 00000100:00100000:2.0:1788863784.767209:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298873600:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863784.767245:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298873600:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 36us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863784.767271:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 300 00010000:00010000:2.0:1788863784.918113:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863785.046228:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863785.046255:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324020736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863785.046340:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863785.046653:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324020736 00000100:00100000:0.0:1788863785.046662:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324020736 00000100:00100000:0.0:1788863785.046760:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788863785.046770:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324020736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863785.046807:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863785.046884:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324020736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863785.046891:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788863785.046975:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788863785.046982:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1788863785.047007:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8bee334700, transno 4294967310 00000100:00100000:2.0:1788863785.047034:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324020736:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788863785.047096:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788863785.187009:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863785.187031:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863785.187080:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788863785.187089:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788863785.946142:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863786.969320:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788863787.191041:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788863787.191070:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8bcf0c7d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788863787.191075:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bc9369800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bcf0c7600 00000020:00080000:1.0:1788863787.191079:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bc9369100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bff13cc00 00000020:00080000:1.0:1788863787.191102:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788863787.191106:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000020:00080000:1.0:1788863787.191125:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788863787.191331:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1788863787.217015:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1788863787.217032:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1788863787.217038:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:1.0:1788863787.991318:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863788.118490:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759324021120:0@lo:400:kworker.0 00000100:00100000:0.0:1788863788.118570:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863788.118704:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759324020864:0@lo:400:kworker.0 00000100:00100000:0.0:1788863788.119021:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788863788.119029:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324020992:0@lo:400:kworker.0 00000100:00100000:1.0:1788863788.119115:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324021248:0@lo:400:kworker.0 00000100:00100000:2.0:1788863788.120384:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863788.120425:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324021376:0@lo:400:kworker.0 00000100:00100000:2.0:1788863788.120455:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863788.120494:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324020864 00000100:00100000:2.0:1788863788.120502:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324020864 00000100:00100000:2.0:1788863788.120546:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788863788.120555:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759324020864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863788.120605:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759324020864:12345-0@lo:400:kworker.0 Request processed in 51us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863788.120611:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788863788.120660:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324021120 00000100:00100000:2.0:1788863788.120664:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324021120 00000100:00100000:2.0:1788863788.120696:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324021376 00000100:00100000:2.0:1788863788.120699:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324021376 00000100:00100000:2.0:1788863788.120720:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788863788.120740:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759324021120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863788.120773:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759324021120:12345-0@lo:400:kworker.0 Request processed in 35us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863788.120780:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788863788.120794:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788863788.120799:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324021376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863788.121311:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324021376:12345-0@lo:400:kworker.0 Request processed in 510us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863788.121318:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1788863788.121339:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863788.121373:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759324020864:0@lo:400:kworker.0 00000100:00100000:2.0:1788863788.121388:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324021376:0@lo:400:kworker.0 00000100:00100000:0.0:1788863788.132997:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863788.133054:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bfb533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324021504:0@lo:400:kworker.0 00000100:00100000:0.0:1788863788.133112:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863788.133164:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759324021120:0@lo:400:kworker.0 00000100:00100000:0.0:1788863788.133226:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324020992 00000100:00100000:0.0:1788863788.133233:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324020992 00000100:00100000:0.0:1788863788.133288:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788863788.133301:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324020992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863788.133358:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324020992:12345-0@lo:400:kworker.0 Request processed in 62us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863788.133365:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788863788.133441:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863788.133468:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324021632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863788.133495:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863788.134164:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324020992:0@lo:400:kworker.0 00000100:00100000:3.0:1788863788.134426:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863788.135894:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324021504 00000100:00100000:2.0:1788863788.135909:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324021504 00000100:00100000:2.0:1788863788.136026:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324021248 00000100:00100000:2.0:1788863788.136030:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324021248 00000100:00100000:2.0:1788863788.136066:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788863788.136159:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863788.136164:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863788.136271:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324021632 00000100:00100000:0.0:1788863788.136277:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324021632 00000100:00100000:0.0:1788863788.136320:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788863788.136329:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875759324021632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788863788.136369:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863788.136444:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875759324021632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (2947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863788.136451:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788863788.136492:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788863788.136498:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8bfb95ca80, transno 4294967322 00000004:00080000:0.0:1788863788.136510:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788863788.136542:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324021632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863788.136680:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324021504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863788.136730:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324021504:12345-0@lo:400:kworker.0 Request processed in 657us (3618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863788.136738:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788863788.136753:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788863788.136760:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324021248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863788.136824:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324021248:12345-0@lo:400:kworker.0 Request processed in 65us (2398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863788.136887:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788863788.136934:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bfb533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324021504:0@lo:400:kworker.0 00000100:00100000:2.0:1788863788.136966:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324021248:0@lo:400:kworker.0 00010000:00010000:2.0:1788863789.014845:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863789.888985:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863789.889031:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863789.889053:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863789.889087:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863789.889232:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298874240 00000100:00100000:0.0:1788863789.889244:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298874240 00000100:00100000:0.0:1788863789.889317:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 302 00000100:00100000:0.0:1788863789.889328:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298874240:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863789.889399:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2350:x1875759298874240:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 72us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863789.889406:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 302 00000100:00100000:0.0:1788863789.889439:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298874496 00000100:00100000:0.0:1788863789.889443:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298874496 00000100:00100000:0.0:1788863789.889480:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:0.0:1788863789.889486:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298874496:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863789.889528:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2350:x1875759298874496:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 42us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863789.889541:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00080000:0.0:1788863789.889682:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863789.890633:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298874368 00000100:00100000:2.0:1788863789.890641:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298874368 00000100:00100000:2.0:1788863789.890694:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298874752 00000100:00100000:2.0:1788863789.890698:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298874752 00000100:00100000:2.0:1788863789.890726:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:2.0:1788863789.890734:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:2351:x1875759298874368:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863789.890787:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:2351:x1875759298874368:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 54us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863789.890794:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:2.0:1788863789.890810:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 174 00000100:00100000:2.0:1788863789.890816:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298874752:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863789.890839:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2350:x1875759298874752:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863789.890845:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 174 00000100:00080000:0.0:1788863789.892767:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863789.893976:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863789.894687:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298874624 00000100:00100000:0.0:1788863789.894698:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298874624 00000100:00100000:0.0:1788863789.894783:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:0.0:1788863789.894801:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298874624:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863789.894918:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298874624:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 126us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863789.894938:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00080000:2.0:1788863789.895715:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788863790.041348:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863790.169277:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863790.169302:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffe09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324021760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863790.169387:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863790.171973:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324021760 00000100:00100000:0.0:1788863790.171992:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324021760 00000100:00100000:0.0:1788863790.172095:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788863790.172107:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324021760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863790.172151:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863790.172241:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324021760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863790.172249:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788863790.172628:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863790.172945:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffe09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324021760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863791.064465:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863791.924503:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863791.924628:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298874880 00000100:00100000:0.0:1788863791.924640:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298874880 00000100:00100000:0.0:1788863791.924717:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 237 00000100:00100000:0.0:1788863791.924730:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:11289:x1875759298874880:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1788863791.924966:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863791.928384:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:11289:x1875759298874880:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 Request processed in 3645us (3881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863791.928398:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 237 00000100:00100000:0.0:1788863791.952823:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863791.953324:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298875136 00000100:00100000:1.0:1788863791.953335:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298875136 00000100:00100000:1.0:1788863791.953397:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:1.0:1788863791.953407:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:11289:x1875759298875136:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788863791.953760:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:11289:x1875759298875136:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 353us (946us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788863791.953768:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00010000:00010000:1.0:1788863792.088686:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788863792.344065:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788863792.344090:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788863792.344228:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788863792.344239:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788863793.110429:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863793.238470:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324021888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863793.238556:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863793.238846:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324021888 00000100:00100000:3.0:1788863793.238880:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324021888 00000100:00100000:3.0:1788863793.238957:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788863793.238968:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd01a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324021888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863793.239009:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863793.242474:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759324022016:0@lo:400:kworker.0 00000100:00100000:0.0:1788863793.242575:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863793.242698:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863793.242705:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324022144:0@lo:400:kworker.0 00000100:00100000:0.0:1788863793.242736:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863793.242775:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324022016 00000100:00100000:0.0:1788863793.242783:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324022016 00000100:00100000:0.0:1788863793.242832:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788863793.242895:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759324022016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863793.242955:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759324022016:12345-0@lo:400:kworker.0 Request processed in 112us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863793.242962:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788863793.242999:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324022272:0@lo:400:kworker.0 00000100:00100000:0.0:1788863793.243024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863793.243094:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759324022016:0@lo:400:kworker.0 00000100:00100000:0.0:1788863793.243145:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324022144 00000100:00100000:0.0:1788863793.243149:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324022144 00000100:00100000:0.0:1788863793.243180:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324022272 00000100:00100000:0.0:1788863793.243183:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324022272 00000100:00100000:0.0:1788863793.243218:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788863793.243225:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324022144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863793.243266:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324022144:12345-0@lo:400:kworker.0 Request processed in 41us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863793.243272:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788863793.243284:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788863793.243309:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759324022272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863793.243344:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759324022272:12345-0@lo:400:kworker.0 Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863793.243349:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788863793.243390:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324022272:0@lo:400:kworker.0 00000100:00100000:0.0:1788863793.243410:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324022144:0@lo:400:kworker.0 00000100:00080000:0.0:1788863793.243448:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863793.243453:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863793.253135:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd01a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324021888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14151us (14559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863793.253151:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788863793.267560:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324021888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863793.269091:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863793.269109:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759324022528:0@lo:400:kworker.0 00000100:00100000:2.0:1788863793.269172:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863793.269214:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324022528 00000100:00100000:2.0:1788863793.269221:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324022528 00000100:00100000:2.0:1788863793.269289:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788863793.269298:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759324022528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863793.269348:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759324022528:12345-0@lo:400:kworker.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863793.269355:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788863793.269390:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759324022528:0@lo:400:kworker.0 00000100:00080000:0.0:1788863793.269744:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863793.269752:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863793.269762:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324022400:0@lo:400:kworker.0 00000100:00100000:0.0:1788863793.269795:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863793.272091:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324022400 00000100:00100000:2.0:1788863793.272109:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324022400 00000100:00100000:2.0:1788863793.272198:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788863793.272209:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324022400:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788863793.272576:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863793.272901:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324022400:12345-0@lo:400:kworker.0 Request processed in 693us (3103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863793.272910:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788863793.273089:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324022400:0@lo:400:kworker.0 00010000:00010000:2.0:1788863794.134728:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863795.011968:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863795.012028:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863795.012057:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863795.012077:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863795.012104:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863795.012133:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298875520 00000100:00100000:2.0:1788863795.012143:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298875520 00000100:00100000:2.0:1788863795.012191:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298875648 00000100:00100000:2.0:1788863795.012194:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298875648 00000100:00100000:2.0:1788863795.012219:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:2.0:1788863795.012228:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298875520:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863795.012308:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2351:x1875759298875520:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863795.012315:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:2.0:1788863795.012345:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:2.0:1788863795.012351:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298875648:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863795.012373:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2351:x1875759298875648:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863795.012380:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:2.0:1788863795.012397:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298875776 00000100:00100000:2.0:1788863795.012400:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298875776 00000100:00100000:2.0:1788863795.012427:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298875392 00000100:00100000:2.0:1788863795.012430:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298875392 00000100:00100000:2.0:1788863795.012450:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 178 00000100:00100000:2.0:1788863795.012457:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298875776:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863795.012495:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2351:x1875759298875776:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863795.012501:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 178 00000100:00100000:2.0:1788863795.012513:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 179 00000100:00100000:2.0:1788863795.012520:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:2351:x1875759298875392:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863795.012550:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:2351:x1875759298875392:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 31us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863795.012556:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 179 00000100:00080000:2.0:1788863795.012579:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863795.012583:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863795.012585:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863795.012767:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298875264 00000100:00100000:1.0:1788863795.012772:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298875264 00000100:00100000:1.0:1788863795.012801:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 304 00000100:00100000:1.0:1788863795.012808:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298875264:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863795.012835:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2351:x1875759298875264:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863795.012841:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 304 00010000:00010000:1.0:1788863795.159748:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863795.306506:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863795.306531:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324022656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863795.306599:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863795.306667:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324022656 00000100:00100000:3.0:1788863795.306676:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324022656 00000100:00100000:3.0:1788863795.306732:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788863795.306740:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324022656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863795.306773:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863795.306815:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324022656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863795.306822:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788863795.306885:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324022656:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788863795.307114:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788863795.433559:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863795.433569:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863795.436259:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788863795.436276:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:0.0:1788863795.520775:0:12720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 06:36:32 (1788863792) 00010000:00010000:1.0:1788863796.194681:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863797.206084:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863798.235997:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863798.358019:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324022784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863798.358903:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863798.359055:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8ac19a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759324022912:0@lo:400:kworker.0 00000100:00100000:1.0:1788863798.359783:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863798.359824:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff1e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324023424:0@lo:400:kworker.0 00000100:00100000:1.0:1788863798.359871:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863798.359896:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863798.359903:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff1e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324023296:0@lo:400:kworker.0 00000100:00100000:1.0:1788863798.359929:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863798.359969:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324023040:0@lo:400:kworker.0 00000100:00100000:3.0:1788863798.359973:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324022784 00000100:00100000:0.0:1788863798.359982:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324022912 00000100:00100000:3.0:1788863798.359983:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324022784 00000100:00100000:0.0:1788863798.359989:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324022912 00000100:00100000:1.0:1788863798.359997:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863798.360019:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863798.360026:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff1e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324023168:0@lo:400:kworker.0 00000100:00100000:0.0:1788863798.360039:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788863798.360046:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863798.360048:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759324022912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863798.360061:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788863798.360072:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324022784:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863798.360081:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324023424 00000100:00100000:1.0:1788863798.360087:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324023424 00002000:00000024:3.0:1788863798.360106:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863798.360108:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eff03fbe-e653-4192-b926-0416f2048378+19:3307:x1875759324022912:12345-0@lo:400:kworker.0 Request processed in 60us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863798.360118:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324023040 00000100:00100000:1.0:1788863798.360123:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324023040 00000100:00100000:1.0:1788863798.360148:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324023168 00000100:00100000:1.0:1788863798.360151:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324023168 00000100:00100000:3.0:1788863798.360156:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324022784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863798.360165:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788863798.360171:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788863798.360180:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324023424:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788863798.360188:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863798.360192:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:3.0:1788863798.360575:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863798.360981:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788863798.360993:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324023040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863798.361411:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324023424:12345-0@lo:400:kworker.0 Request processed in 1230us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863798.361434:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788863798.361459:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788863798.361468:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324023168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863798.362765:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324023040:12345-0@lo:400:kworker.0 Request processed in 1767us (2760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863798.362776:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788863798.362934:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324023296 00000100:00100000:0.0:1788863798.362943:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324023296 00000100:00100000:0.0:1788863798.362989:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788863798.362996:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324023296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863798.363036:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324023296:12345-0@lo:400:kworker.0 Request processed in 41us (3106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863798.363041:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788863798.363839:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324023168:12345-0@lo:400:kworker.0 Request processed in 2370us (3787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863798.363862:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788863798.363916:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff1e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324023296:0@lo:400:kworker.0 00000100:00100000:1.0:1788863798.363929:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8ac19a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eff03fbe-e653-4192-b926-0416f2048378:3307:1875759324022912:0@lo:400:kworker.0 00000100:00100000:1.0:1788863798.363941:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff1e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324023424:0@lo:400:kworker.0 00000100:00100000:1.0:1788863798.363997:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324022784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863798.365960:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff1e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324023168:0@lo:400:kworker.0 00000100:00100000:3.0:1788863798.365988:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324023040:0@lo:400:kworker.0 00000100:00080000:2.0:1788863798.367928:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863798.875658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863798.875755:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298875904 00000100:00100000:2.0:1788863798.875893:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298875904 00000100:00100000:2.0:1788863798.875971:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 238 00000100:00100000:2.0:1788863798.875981:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:12293:x1875759298875904:12345-192.168.204.51@tcp:101:lsof.0 00010000:00010000:2.0:1788863798.876009:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863798.876092:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbbaef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331205 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863798.876175:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbbaf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863798.876192:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbbaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863798.876206:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbbaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863798.876246:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788863798.876250:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863798.876298:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbbaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863798.876323:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554200/0x744cd7666bbbbaef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331205 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863798.876342:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbbaf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331205 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863798.876372:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330200) 00010000:00010000:2.0:1788863798.876375:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863798.876378:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555600, rc 0) 00000100:00100000:2.0:1788863798.876462:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:12293:x1875759298875904:12345-192.168.204.51@tcp:101:lsof.0 Request processed in 481us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863798.876472:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 238 00000100:00080000:3.0:1788863798.876577:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788863799.254568:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863800.136640:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863800.136696:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863800.136896:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298876032 00000100:00100000:0.0:1788863800.136906:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298876032 00000100:00100000:0.0:1788863800.136988:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 306 00000100:00100000:0.0:1788863800.137000:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2352:x1875759298876032:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788863800.137138:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2352:x1875759298876032:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 140us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863800.137145:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 306 00000100:00100000:2.0:1788863800.140049:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298876160 00000100:00100000:2.0:1788863800.140075:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298876160 00000100:00100000:2.0:1788863800.140217:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 183 00000100:00100000:2.0:1788863800.140231:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:2352:x1875759298876160:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863800.140350:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:2352:x1875759298876160:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 121us (3718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863800.140358:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 183 00000100:00080000:0.0:1788863800.144565:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863800.149335:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863800.149398:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863800.149563:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298876416 00000100:00100000:2.0:1788863800.149576:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298876416 00000100:00100000:2.0:1788863800.149655:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298876288 00000100:00100000:2.0:1788863800.149658:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298876288 00000100:00100000:2.0:1788863800.149682:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:2.0:1788863800.149693:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8ac19a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2353:x1875759298876416:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863800.149772:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:1.0:1788863800.149784:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+5:2349:x1875759298876288:12345-192.168.204.51@tcp:9:kworker.0 00000100:00100000:2.0:1788863800.149795:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8ac19a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2353:x1875759298876416:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 102us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863800.149804:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00000020:00000080:1.0:1788863800.149813:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbae54 00000100:00080000:1.0:1788863800.149840:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8e8bffe57000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788863800.151125:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788863800.151135:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788863800.151602:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788863800.151689:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788863800.152028:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+2:2349:x1875759298876288:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 2242us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863800.152041:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:3.0:1788863800.155639:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863800.156041:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298876544 00000100:00100000:2.0:1788863800.156054:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298876544 00000100:00100000:2.0:1788863800.156188:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 184 00000100:00100000:2.0:1788863800.156202:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:2352:x1875759298876544:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:0.0:1788863800.156418:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863800.156753:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:2352:x1875759298876544:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 553us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863800.156762:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 184 00010000:00010000:2.0:1788863800.278572:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863800.411656:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863800.411689:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324023552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863800.411775:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863800.414085:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324023552 00000100:00100000:0.0:1788863800.414126:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324023552 00000100:00100000:0.0:1788863800.414256:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788863800.414269:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324023552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863800.414329:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863800.414455:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324023552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (2678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863800.414463:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788863800.414608:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324023552:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788863800.414844:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788863801.302224:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863801.944630:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863801.951823:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298876800 00000100:00100000:0.0:1788863801.951880:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298876800 00000100:00100000:0.0:1788863801.951980:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:0.0:1788863801.951992:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+18:12294:x1875759298876800:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:0.0:1788863801.952584:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:12294:x1875759298876800:12345-192.168.204.51@tcp:35:umount.0 Request processed in 589us (7969us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788863801.952594:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:2.0:1788863801.959728:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863801.960070:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298877056 00000100:00100000:0.0:1788863801.960088:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298877056 00000100:00100000:0.0:1788863801.960176:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:0.0:1788863801.960190:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+19:12294:x1875759298877056:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:0.0:1788863801.961684:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:12294:x1875759298877056:12345-192.168.204.51@tcp:35:umount.0 Request processed in 1484us (1986us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788863801.961708:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:1.0:1788863801.973154:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863801.973338:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298877312 00000100:00100000:3.0:1788863801.973369:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298877312 00000100:00100000:3.0:1788863801.973617:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:3.0:1788863801.973632:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc2e8f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+20:12294:x1875759298877312:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:3.0:1788863801.974070:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc2e8f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:12294:x1875759298877312:12345-192.168.204.51@tcp:35:umount.0 Request processed in 440us (935us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788863801.974080:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:2.0:1788863801.995341:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863801.996654:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298877568 00000100:00100000:0.0:1788863801.996677:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298877568 00000100:00100000:0.0:1788863801.997052:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:0.0:1788863801.997066:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+21:12294:x1875759298877568:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:0.0:1788863801.998570:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+22:12294:x1875759298877568:12345-192.168.204.51@tcp:35:umount.0 Request processed in 1491us (3229us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788863801.998613:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1788863802.012303:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863802.012379:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863802.012419:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863802.012625:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298877824 00000100:00100000:0.0:1788863802.012643:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298877824 00000100:00100000:0.0:1788863802.012750:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298877696 00000100:00100000:0.0:1788863802.012754:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298877696 00000100:00100000:0.0:1788863802.012769:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298877952 00000100:00100000:0.0:1788863802.012771:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298877952 00000100:00100000:0.0:1788863802.012795:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1788863802.012806:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc66fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+15:2352:x1875759298877824:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863802.012835:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863802.012920:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8c021c7800/0x744cd7666bbbaae2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d5f expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863802.012955:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863802.013039:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc66fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+14:2352:x1875759298877824:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 234us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863802.013047:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1788863802.013117:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:0.0:1788863802.013123:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfbbdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+13:2352:x1875759298877696:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863802.013132:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863802.013142:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7bc00/0x744cd7666bbbab1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d97 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863802.013152:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863802.013170:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfbbdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:2352:x1875759298877696:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 47us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863802.013175:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:0.0:1788863802.013215:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:0.0:1788863802.013222:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:2352:x1875759298877952:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863802.013229:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863802.013253:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbad66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e62 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863802.013263:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863802.013282:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2352:x1875759298877952:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 61us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863802.013288:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1788863802.016571:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863802.016936:0:10277:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298878336 00000100:00100000:0.0:1788863802.016956:0:10277:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298878336 00000100:00100000:0.0:1788863802.017138:0:10277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:0.0:1788863802.017151:0:10277:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2349:x1875759298878336:12345-192.168.204.51@tcp:9:umount.0 00000020:00000080:0.0:1788863802.017202:0:10277:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbb0b5 00000020:00010000:0.0:1788863802.017214:0:10277:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e8bd2996800: total 0 00000100:00080000:0.0:1788863802.017220:0:10277:0:(import.c:65:import_set_state_nolock()) ffff8e8bfb3aa800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788863802.017485:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:0.0:1788863802.017573:0:10277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1788863802.017809:0:5828:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e8bd2996800: total 0 00010000:00010000:1.0:1788863802.017907:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e8bd2996800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788863802.018017:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000974e1151/0x744cd7666bbbbae8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311fe expref: 6 pid: 10277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863802.018078:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e2c281/0x744cd7666bbbb458 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331037 expref: 5 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863802.018096:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e8bd2996800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788863802.018107:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863802.018110:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863802.018112:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863802.023438:0:10277:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+2:2349:x1875759298878336:12345-192.168.204.51@tcp:9:umount.0 Request processed in 6268us (6865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863802.023459:0:10277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:2.0:1788863802.043496:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863802.043976:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298879360 00000100:00100000:0.0:1788863802.043987:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298879360 00000100:00100000:0.0:1788863802.044657:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00100000:0.0:1788863802.044671:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+22:2349:x1875759298879360:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:0.0:1788863802.044717:0:9496:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbaaf0 00000020:00010000:0.0:1788863802.045271:0:9496:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e8bd23dc000: total 0 00000100:00080000:0.0:1788863802.045296:0:9496:0:(import.c:65:import_set_state_nolock()) ffff8e8bd23db000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788863802.045331:0:9496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:2.0:1788863802.045878:0:8443:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e8bd23dc000: total 0 00010000:00010000:2.0:1788863802.045930:0:8443:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e8bd23dc000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788863802.045967:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8bc3015d00) 00010000:00010000:2.0:1788863802.045971:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863802.045981:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17800/0x744cd7666bbbadba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e70 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046009:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:2.0:1788863802.046012:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788863802.046017:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7be00/0x744cd7666bbbb443 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331030 expref: 22 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046060:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:2.0:1788863802.046062:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863802.046067:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b800/0x744cd7666bbbbaa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311e9 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046091:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863802.046093:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788863802.046096:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0031200/0x744cd7666bbbae2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e8c expref: 20 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046108:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330200) 00010000:00010000:2.0:1788863802.046110:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863802.046113:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555a00/0x744cd7666bbbb4ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33104c expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046122:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8bcb0f5500) 00010000:00010000:2.0:1788863802.046123:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788863802.046126:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbb117 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330f5e expref: 18 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046138:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:2.0:1788863802.046140:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863802.046143:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554400/0x744cd7666bbbb339 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330fea expref: 17 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046154:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863802.046156:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788863802.046166:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a600/0x744cd7666bbbb7a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331125 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046176:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:2.0:1788863802.046178:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788863802.046181:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18a000/0x744cd7666bbbbad3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311f7 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046190:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8bc3015200) 00010000:00010000:2.0:1788863802.046192:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788863802.046195:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16c00/0x744cd7666bbbb9c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3311b1 expref: 14 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046208:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8bcb0f5400) 00010000:00010000:2.0:1788863802.046210:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788863802.046213:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18ba00/0x744cd7666bbbb4c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331053 expref: 13 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046224:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bcb0f5900) 00010000:00010000:2.0:1788863802.046225:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863802.046228:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bc0030000/0x744cd7666bbbadd6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e77 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046240:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8bd20ddb00) 00010000:00010000:2.0:1788863802.046242:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788863802.046245:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bff18b800/0x744cd7666bbbb419 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331022 expref: 11 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863802.046256:0:8443:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e8bd23dc000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788863802.046273:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863802.046276:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863802.046278:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863802.047576:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6fd3bcef-c680-4c25-aae1-ecd03903ad0a+7:2349:x1875759298879360:12345-192.168.204.51@tcp:39:umount.0 Request processed in 2900us (4084us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788863802.047589:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00080000:3.0:1788863802.048465:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788863802.326226:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788863802.571214:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000001:00080000:0.0:1788863802.571235:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788863802.571251:0:5862:0:(genops.c:885:class_export_put()) final put ffff8e8bd23dc000/6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000020:00000080:2.0:1788863802.571368:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bd23dc000/6fd3bcef-c680-4c25-aae1-ecd03903ad0a for lustre-MDT0000 00000020:00000080:2.0:1788863802.571449:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bd23db000 for lustre-MDT0000 00000001:00100000:2.0:1788863802.571722:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000020:00000080:2.0:1788863802.571727:0:7637:0:(genops.c:885:class_export_put()) final put ffff8e8bd2996800/6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000020:00000080:3.0:1788863802.571964:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bd2996800/6fd3bcef-c680-4c25-aae1-ecd03903ad0a for lustre-OST0001 00000020:00000080:3.0:1788863802.572012:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bfb3aa800 for lustre-OST0001 00010000:00010000:2.0:1788863803.351335:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863803.479124:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff1e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324023680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863803.479203:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863803.479481:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324024192:0@lo:400:kworker.0 00000100:00100000:2.0:1788863803.479524:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863803.479545:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863803.479551:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759324024064:0@lo:400:kworker.0 00000100:00100000:2.0:1788863803.479578:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863803.479609:0:12016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324024192 00000100:00100000:2.0:1788863803.479618:0:12016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324024192 00000100:00100000:3.0:1788863803.480172:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324023808:0@lo:400:kworker.0 00000100:00100000:3.0:1788863803.480218:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863803.480252:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759324024320:0@lo:400:kworker.0 00000100:00100000:3.0:1788863803.480276:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863803.480298:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863803.480303:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759324023936:0@lo:400:kworker.0 00000100:00100000:3.0:1788863803.480337:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863803.480385:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324023808 00000100:00100000:3.0:1788863803.480390:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324023808 00000100:00100000:3.0:1788863803.480428:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788863803.480439:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759324023808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863803.480522:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eff03fbe-e653-4192-b926-0416f2048378+19:3306:x1875759324023808:12345-0@lo:400:kworker.0 Request processed in 70us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863803.480529:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788863803.480566:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324024064 00000100:00100000:3.0:1788863803.480570:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324024064 00000100:00100000:3.0:1788863803.480599:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324024320 00000100:00100000:3.0:1788863803.480602:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324024320 00000100:00100000:3.0:1788863803.480619:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324023936 00000100:00100000:3.0:1788863803.480621:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324023936 00000100:00100000:3.0:1788863803.480632:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788863803.480638:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759324024064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863803.480672:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759324024064:12345-0@lo:400:kworker.0 Request processed in 33us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863803.480678:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788863803.480690:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788863803.480695:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759324024320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863803.480990:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875759324024320:12345-0@lo:400:kworker.0 Request processed in 294us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863803.480996:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788863803.481010:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788863803.481015:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759324023936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863803.481042:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759324023936:12345-0@lo:400:kworker.0 Request processed in 27us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863803.481047:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788863803.481095:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759324023936:0@lo:400:kworker.0 00000100:00100000:3.0:1788863803.481106:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324023808:0@lo:400:kworker.0 00000100:00100000:3.0:1788863803.481115:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875759324024320:0@lo:400:kworker.0 00000100:00100000:3.0:1788863803.481151:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759324024064:0@lo:400:kworker.0 00000100:00080000:0.0:1788863803.481304:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863803.481311:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863803.481457:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788863803.481475:0:12016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324024192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863803.481539:0:12016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324024192:12345-0@lo:400:kworker.0 Request processed in 71us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863803.481590:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324024192:0@lo:400:kworker.0 00000100:00100000:1.0:1788863803.481715:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324023680 00000100:00100000:1.0:1788863803.481721:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324023680 00000100:00100000:1.0:1788863803.481767:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788863803.481775:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324023680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863803.481811:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863803.481872:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324023680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (2669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863803.481879:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788863803.481925:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff1e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324023680:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788863803.482064:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863803.486171:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788863804.140196:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863804.140226:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863804.140262:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863804.140391:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298879488 00000100:00100000:1.0:1788863804.140404:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298879488 00000100:00100000:1.0:1788863804.140492:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298879744 00000100:00100000:1.0:1788863804.140495:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298879744 00000100:00100000:1.0:1788863804.140511:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298879616 00000100:00100000:1.0:1788863804.140514:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298879616 00000100:00100000:1.0:1788863804.140555:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:1.0:1788863804.140565:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+12:2350:x1875759298879488:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863804.140584:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863804.140604:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7a600/0x744cd7666bbbabc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330dac expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863804.140625:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863804.141125:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+11:2350:x1875759298879488:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 558us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863804.141134:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:1.0:1788863804.141155:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:1.0:1788863804.141163:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+10:2350:x1875759298879744:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863804.141173:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863804.141185:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc166a800/0x744cd7666bbbad5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330e5b expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863804.141197:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863804.141220:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+9:2350:x1875759298879744:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 59us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863804.141226:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:1.0:1788863804.141239:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:1.0:1788863804.141245:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+8:2350:x1875759298879616:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863804.141253:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863804.141262:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0030600/0x744cd7666bbbabc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330dd6 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863804.141282:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863804.141314:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6e1829-9c4d-46c0-a707-b9ed128736b1+7:2350:x1875759298879616:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 58us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863804.141321:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:1.0:1788863804.168436:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863804.173956:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298880000 00000100:00100000:3.0:1788863804.173979:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298880000 00000100:00100000:3.0:1788863804.174092:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 240 00000100:00100000:3.0:1788863804.174105:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff1e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+6:2349:x1875759298880000:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:3.0:1788863804.174597:0:5840:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbabd7 00000020:00010000:3.0:1788863804.174607:0:5840:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e8bfb721000: total 0 00000100:00080000:3.0:1788863804.174613:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8e8bfb721800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788863804.174712:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00080000:0.0:1788863804.174795:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863804.175286:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff1e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93b25027-f4fd-4c57-8714-3a69d8e44d8a+5:2349:x1875759298880000:12345-192.168.204.51@tcp:39:umount.0 Request processed in 1181us (6863us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788863804.175296:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 240 00000020:00010000:1.0:1788863804.182083:0:5828:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e8bfb721000: total 0 00010000:00010000:1.0:1788863804.182162:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e8bfb721000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788863804.182215:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc9330200) 00010000:00010000:1.0:1788863804.182219:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863804.182232:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555600/0x744cd7666bbbbaf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331205 expref: 4 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863804.182259:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e8bfb721000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788863804.182270:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863804.182272:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863804.182275:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863804.218686:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863804.218817:0:5833:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298880256 00000100:00100000:1.0:1788863804.218830:0:5833:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298880256 00000100:00100000:1.0:1788863804.218951:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 308 00000100:00100000:1.0:1788863804.218963:0:5833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+7:2349:x1875759298880256:12345-192.168.204.51@tcp:251:umount.0 00000020:00000080:1.0:1788863804.219024:0:5833:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbaacd 00000020:00010000:1.0:1788863804.219034:0:5833:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e8bf4c44000: total 0 00000100:00080000:1.0:1788863804.219039:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8e8bf4c46000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788863804.219127:0:5833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6e1829-9c4d-46c0-a707-b9ed128736b1+3:2349:x1875759298880256:12345-192.168.204.51@tcp:251:umount.0 Request processed in 166us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863804.219135:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 308 00000020:00010000:2.0:1788863804.219910:0:8443:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e8bf4c44000: total 0 00010000:00010000:2.0:1788863804.219916:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863804.219965:0:8443:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e8bf4c44000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788863804.220010:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbab21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd330d9e expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863804.220027:0:8443:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e8bf4c44000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788863804.220037:0:8443:0:(genops.c:885:class_export_put()) final put ffff8e8bf4c44000/2d6e1829-9c4d-46c0-a707-b9ed128736b1 00010000:00010000:2.0:1788863804.220058:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863804.220061:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863804.220063:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788863804.220364:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bf4c44000/2d6e1829-9c4d-46c0-a707-b9ed128736b1 for MGS 00000020:00000080:3.0:1788863804.220422:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bf4c46000 for MGS 00010000:00010000:2.0:1788863804.374697:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788863804.575935:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000020:00000080:0.0:1788863804.575950:0:6708:0:(genops.c:885:class_export_put()) final put ffff8e8bffe56800/6fd3bcef-c680-4c25-aae1-ecd03903ad0a 00000020:00000080:0.0:1788863804.575984:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bffe56800/6fd3bcef-c680-4c25-aae1-ecd03903ad0a for lustre-OST0000 00000020:00000080:0.0:1788863804.576035:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bffe57000 for lustre-OST0000 00010000:00010000:2.0:1788863805.406763:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863805.526084:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863805.526108:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324024448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863805.526191:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863805.532172:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324024448 00000100:00100000:1.0:1788863805.532191:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324024448 00000100:00100000:1.0:1788863805.532288:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788863805.532302:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324024448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863805.532353:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863805.532447:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324024448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (6255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863805.532455:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788863805.532480:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863805.532535:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324024448:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788863805.656315:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788863805.656328:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788863805.656904:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1788863805.656922:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788863806.422678:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788863806.429940:0:12921:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788863806.457124:0:12921:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788863806.457190:0:12921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.457210:0:12921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.457218:0:12921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.457245:0:12921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.457283:0:12921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788863806.457291:0:12921:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788863806.457330:0:12921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788863806.457337:0:12921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788863806.457343:0:12921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788863806.457376:0:12921:0:(import.c:65:import_set_state_nolock()) ffff8e8becca0000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788863806.457443:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875759324024576:0@lo:39:umount.0 00000100:00100000:3.0:1788863806.457518:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788863806.457616:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863806.457626:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863806.457635:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031c00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:2.0:1788863806.457639:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863806.457650:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863806.457658:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863806.457665:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788863806.457667:0:8443:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788863806.457670:0:8443:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788863806.457713:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863806.457720:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863806.457744:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863806.457751:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031c00/0x744cd7666bbbab60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbab67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863806.457764:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863806.457766:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863806.457767:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863806.457778:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759324024704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863806.457808:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863806.457921:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324024704 00000100:00100000:2.0:1788863806.457930:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324024704 00000100:00100000:2.0:1788863806.457984:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788863806.457994:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca963480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+19:3308:x1875759324024704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863806.458012:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863806.458027:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bffc16200/0x744cd7666bbbab67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbbab60 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863806.458042:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863806.458082:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca963480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eff03fbe-e653-4192-b926-0416f2048378+18:3308:x1875759324024704:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863806.458089:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788863806.458136:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759324024704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863806.458348:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324024576 00000100:00100000:0.0:1788863806.458353:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324024576 00000100:00100000:0.0:1788863806.458401:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788863806.458409:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875759324024576:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788863806.458439:0:9496:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba8ea 00000100:00080000:0.0:1788863806.458448:0:9496:0:(import.c:65:import_set_state_nolock()) ffff8e8bd0122000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788863806.458567:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863806.460195:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1875759324024576:12345-0@lo:39:umount.0 Request processed in 1775us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863806.460213:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:0.0:1788863806.460238:0:9496:0:(genops.c:885:class_export_put()) final put ffff8e8bd0125800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788863806.461194:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bd0125800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788863806.461303:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bd0122000 for lustre-MDT0000 00000100:00080000:3.0:1788863806.463403:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8becca0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788863806.463483:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875759324024576:0@lo:39:umount.0 00000100:00080000:0.0:1788863806.468033:0:12921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788863806.468042:0:12921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788863806.468049:0:12921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788863806.469094:0:12921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469109:0:12921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469134:0:12921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469141:0:12921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469161:0:12921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863806.469166:0:12921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469172:0:12921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469179:0:12921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469185:0:12921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469195:0:12921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788863806.469201:0:12921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469207:0:12921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469213:0:12921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469228:0:12921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469242:0:12921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788863806.469246:0:12921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0c00/0x744cd7666bbba83b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469253:0:12921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0c00/0x744cd7666bbba83b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469269:0:12921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0c00/0x744cd7666bbba83b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469275:0:12921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0c00/0x744cd7666bbba83b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863806.469288:0:12921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788863806.469290:0:12921:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788863806.469317:0:12921:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788863806.469320:0:12921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788863806.469324:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863806.469329:0:12921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1788863806.469336:0:12921:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e8bf4f1c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788863806.469341:0:12921:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e8bff2ca800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788863806.469348:0:12921:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8e8bfb721000 93b25027-f4fd-4c57-8714-3a69d8e44d8a 192.168.204.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788863806.469353:0:12921:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8e8bee48cd40) has exports, disconnecting them 00000020:00080000:0.0:1788863806.469358:0:12921:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e8bf4f1c000), last request at 1788863803 00000020:00000080:0.0:1788863806.469379:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbaa4f 00000100:00080000:0.0:1788863806.469396:0:12921:0:(import.c:65:import_set_state_nolock()) ffff8e8bf4f1e000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788863806.469444:0:12921:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8bf4f1c000): rc 0 00000020:00000080:0.0:1788863806.469447:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bf4f1c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788863806.469460:0:12921:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e8bff2ca800), last request at 1788863803 00000020:00000080:0.0:1788863806.469463:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba984 00000100:00080000:0.0:1788863806.469468:0:12921:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2cc800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788863806.469477:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bf4f1c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788863806.469520:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bf4f1e000 for lustre-MDT0000 00000020:00080000:0.0:1788863806.469531:0:12921:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8bff2ca800): rc 0 00000020:00000080:0.0:1788863806.469533:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bff2ca800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788863806.469542:0:12921:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffacc5c3ca3ae0 00000020:00000080:0.0:1788863806.469551:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bff2ca800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788863806.469575:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bff2cc800 for lustre-MDT0000 00000100:00080000:0.0:1788863806.469593:0:12921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788863806.469597:0:12921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788863806.469606:0:12921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788863806.469671:0:12921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788863806.469691:0:12921:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2c8800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788863806.469705:0:12921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788863806.469707:0:12921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788863806.469713:0:12921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788863806.469779:0:12921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788863806.469785:0:12921:0:(import.c:65:import_set_state_nolock()) ffff8e8bd23dd800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788863806.469877:0:12921:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e8bee48cd40) has no exports 00000100:00100000:3.0:1788863806.469953:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324024832:0@lo:9:umount.0 00000100:00100000:3.0:1788863806.470016:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863806.470049:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324024960:0@lo:9:umount.0 00000100:00100000:3.0:1788863806.470065:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788863806.470089:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788863806.470095:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470102:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17e00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863806.470106:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470115:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863806.470123:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863806.470128:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788863806.470131:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788863806.470133:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788863806.470156:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470169:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863806.470182:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470189:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbab6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbab75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470201:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788863806.470204:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470210:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0031600 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863806.470213:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470220:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863806.470225:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863806.470230:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788863806.470232:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788863806.470234:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788863806.470243:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470247:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863806.470269:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470285:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc0031600/0x744cd7666bbbaa87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbaa8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470298:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788863806.470301:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470307:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17400 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863806.470310:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470317:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863806.470323:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863806.470328:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788863806.470330:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788863806.470331:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788863806.470341:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470347:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863806.470352:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470359:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17400/0x744cd7666bbbad89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbad90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470380:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863806.470384:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0c00/0x744cd7666bbba83b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470389:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc13a0c00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863806.470392:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0c00/0x744cd7666bbba83b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470400:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0c00/0x744cd7666bbba83b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863806.470406:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0c00/0x744cd7666bbba83b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863806.470411:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788863806.470413:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788863806.470415:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788863806.470423:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0c00/0x744cd7666bbba83b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470428:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863806.470433:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0c00/0x744cd7666bbba83b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470439:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc13a0c00/0x744cd7666bbba83b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbba842 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863806.470450:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863806.470452:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863806.470457:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863806.470519:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863806.470541:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324024832 00000100:00100000:2.0:1788863806.470549:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324024832 00000100:00100000:2.0:1788863806.470595:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324024960 00000100:00100000:2.0:1788863806.470598:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324024960 00000100:00100000:2.0:1788863806.470625:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788863806.470632:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875759324024832:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788863806.470653:0:6680:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba9df 00000100:00080000:2.0:1788863806.470659:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8e8beda4e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788863806.470684:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788863806.471015:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1875759324024832:12345-0@lo:9:umount.0 Request processed in 381us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863806.471023:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788863806.471039:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788863806.471046:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bfb95f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875759324024960:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788863806.471059:0:6680:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbaab8 00000100:00080000:2.0:1788863806.471065:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8e8bf4f1d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788863806.471083:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788863806.471280:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bfb95f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1875759324024960:12345-0@lo:9:umount.0 Request processed in 233us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863806.471286:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788863806.471306:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863806.471324:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759324025088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863806.471358:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863806.471391:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863806.471397:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759324025472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863806.471417:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863806.471443:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324025088 00000100:00100000:2.0:1788863806.471447:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324025088 00000100:00100000:2.0:1788863806.471491:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324025472 00000100:00100000:2.0:1788863806.471496:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324025472 00000100:00100000:2.0:1788863806.471513:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788863806.471519:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc66fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+19:3309:x1875759324025088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863806.471528:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863806.471542:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7b200/0x744cd7666bbbab75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbbab6e expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863806.471556:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863806.471581:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc66fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+18:3309:x1875759324025088:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863806.471587:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788863806.471625:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788863806.471631:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca963100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+17:3309:x1875759324025472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863806.471637:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863806.471644:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc166be00/0x744cd7666bbba842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbba83b expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863806.471657:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863806.471678:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca963100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eff03fbe-e653-4192-b926-0416f2048378+16:3309:x1875759324025472:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863806.471683:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788863806.471706:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863806.471732:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759324025472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863806.471740:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759324025088:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788863806.471766:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2c8800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788863806.471777:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788863806.471785:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788863806.471789:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324024832:0@lo:9:umount.0 00000100:00080000:2.0:1788863806.471802:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bd23dd800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788863806.471805:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788863806.471807:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788863806.471809:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324024960:0@lo:9:umount.0 00010000:00010000:2.0:1788863806.471833:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863806.472039:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324025216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863806.472070:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863806.472096:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863806.472101:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324025344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863806.472118:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863806.472145:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324025216 00000100:00100000:1.0:1788863806.472149:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324025216 00000100:00100000:1.0:1788863806.472176:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324025344 00000100:00100000:1.0:1788863806.472178:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324025344 00000100:00100000:1.0:1788863806.472195:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788863806.472200:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+17:3306:x1875759324025216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863806.472208:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863806.472217:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc13a0800/0x744cd7666bbbaa8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbbaa87 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863806.472236:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863806.472277:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+16:3306:x1875759324025216:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863806.472283:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788863806.472296:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788863806.472302:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+15:3306:x1875759324025344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863806.472309:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863806.472318:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc166ae00/0x744cd7666bbbad90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbbad89 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863806.472327:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863806.472347:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eff03fbe-e653-4192-b926-0416f2048378+14:3306:x1875759324025344:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863806.472354:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788863806.472372:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863806.472389:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324025344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863806.472396:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324025216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863806.472412:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788863806.501039:0:12921:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e8bee48cd40) has no exports 00000020:00000080:2.0:1788863806.615935:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba896 00000020:00000080:2.0:1788863806.615952:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bedca4000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788863806.615969:0:12921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788863806.616209:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863806.616221:0:12921:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788863806.616226:0:12921:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8e8bd0083380) has no exports 00000020:00000080:1.0:1788863806.616377:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bedca4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788863806.616809:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba88f 00000020:00000080:3.0:1788863806.616816:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8beed82800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788863806.616897:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863806.616907:0:12921:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788863806.616910:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8beda08800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788863806.616912:0:12921:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8beda08800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788863806.616920:0:12921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788863806.617075:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8beed82800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788863807.450050:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788863807.636548:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788863807.636558:0:7637:0:(genops.c:885:class_export_put()) final put ffff8e8bf4f1a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788863807.636599:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bf4f1a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788863807.636646:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bf4f1d800 for lustre-OST0001 00000001:00100000:0.0:1788863807.669308:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 93b25027-f4fd-4c57-8714-3a69d8e44d8a 00000001:00080000:0.0:1788863807.669329:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788863807.669334:0:5862:0:(genops.c:885:class_export_put()) final put ffff8e8bfb721000/93b25027-f4fd-4c57-8714-3a69d8e44d8a 00000020:00000080:0.0:1788863807.669419:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bfb721000/93b25027-f4fd-4c57-8714-3a69d8e44d8a for lustre-MDT0000 00000020:00000080:0.0:1788863807.669478:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bfb721800 for lustre-MDT0000 00010000:00010000:2.0:1788863808.472476:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863808.598420:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759324025600:0@lo:400:kworker.0 00000100:00100000:2.0:1788863808.598540:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863808.598828:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324025600 00000100:00100000:0.0:1788863808.598837:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324025600 00000100:00100000:1.0:1788863808.598872:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324025728:0@lo:400:kworker.0 00000100:00100000:3.0:1788863808.599016:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324025856:0@lo:400:kworker.0 00000100:00100000:0.0:1788863808.599679:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788863808.599694:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd2871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+14:3309:x1875759324025600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863808.604455:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863808.604690:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324025728 00000100:00100000:1.0:1788863808.604703:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324025728 00000100:00100000:1.0:1788863808.604830:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788863808.604871:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3306:x1875759324025728:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788863808.604882:0:6707:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788863808.604944:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3306:x1875759324025728:12345-0@lo:400:kworker.0 Request processed in 91us (498us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788863808.604952:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:1.0:1788863808.605136:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788863808.605142:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8e8bff594800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788863808.605146:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788863808.608678:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863808.610625:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd2871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eff03fbe-e653-4192-b926-0416f2048378+14:3309:x1875759324025600:12345-0@lo:400:kworker.0 Request processed in 10924us (12073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863808.610643:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788863808.610913:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:3309:1875759324025600:0@lo:400:kworker.0 00000100:00100000:2.0:1788863808.611105:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324025856 00000100:00100000:2.0:1788863808.611114:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324025856 00000100:00100000:2.0:1788863808.611196:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788863808.611205:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875759324025856:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788863808.611224:0:5840:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788863808.611288:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875759324025856:12345-0@lo:400:kworker.0 Request processed in 82us (2620us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788863808.611295:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1788863808.611367:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788863808.611373:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2ce800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788863808.611377:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788863808.611383:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2ce800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788863808.611387:0:3307:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 234 00000100:00080000:3.0:1788863808.611397:0:3307:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e8bff2ce800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788863808.611434:0:3307:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bffcfea00 x1875759324025984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788863808.611462:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324025856:0@lo:400:kworker.0 00000100:00100000:2.0:1788863808.616015:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875759324025984:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788863808.616203:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863808.616900:0:9496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324025984 00000100:00100000:0.0:1788863808.616913:0:9496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324025984 00000100:00100000:0.0:1788863808.616971:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788863808.616981:0:9496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3305:x1875759324025984:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788863808.617007:0:9496:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1788863808.617981:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8e8bff594800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863808.617989:0:3306:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 213 00000100:00080000:1.0:1788863808.618002:0:3306:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e8bff594800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788863808.618050:0:3306:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bc8517100 x1875759324026112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863808.618078:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324025728:0@lo:400:kworker.0 00000100:00100000:2.0:1788863808.618301:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875759324026112:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788863808.618392:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863808.618574:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324026112 00000100:00100000:3.0:1788863808.618583:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324026112 00000100:00100000:3.0:1788863808.618625:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788863808.618633:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875759324026112:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788863808.618671:0:5842:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788863808.618740:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875759324026112:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 96us (337us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788863808.618749:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1788863808.618774:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff594800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863808.618779:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788863808.618783:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875759324026112:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788863808.644297:0:9496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3305:x1875759324025984:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 27299us (28075us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788863808.644332:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1788863808.644589:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863808.644595:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788863808.644599:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875759324025984:0@lo:38:ptlrpcd_00_01.0 00000020:01000000:3.0:1788863808.662012:0:12921:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8e8bde7b3120 - data ffff8e8bfa255d80/ffff8e8bf4c4c400 00000020:01000000:3.0:1788863808.662576:0:12921:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8e8bfb181900 - data ffff8e8be9471870/ffff8e8c0174b000 00000001:00000004:3.0:1788863808.675542:0:12921:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1788863808.755258:0:12921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788863808.755271:0:12921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788863808.755297:0:12921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788863808.755300:0:12921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788863808.756359:0:6705:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788863808.756368:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788863808.756382:0:6705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788863808.761315:0:12921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788863808.761328:0:12921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788863808.761386:0:12921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788863808.761389:0:12921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788863808.762489:0:8026:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788863808.762503:0:8026:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788863808.762518:0:8026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788863808.825915:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba85e 00000020:00000080:3.0:1788863808.825929:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bee567000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788863808.826765:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bee567000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788863808.829378:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba873 00000020:00000080:3.0:1788863808.829391:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bee565800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788863808.829454:0:12921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788863808.829462:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863808.829472:0:12921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788863808.829476:0:12921:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8e8bee488000) has no exports 00000004:01000000:3.0:1788863808.829686:0:12921:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788863808.829696:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbaab1 00000020:00000080:3.0:1788863808.829700:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bd23db800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788863808.830691:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bee565800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788863808.830843:0:12921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788863808.830872:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863808.830885:0:12921:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788863808.830890:0:12921:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8e8bff0319c0) has no exports 00000020:00000080:3.0:1788863808.830917:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbaaaa 00000020:00000080:3.0:1788863808.830924:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bd23da000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788863808.831316:0:12921:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788863808.831321:0:12921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788863808.831326:0:12921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788863808.831332:0:12921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788863808.831334:0:12921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788863808.831371:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863808.831380:0:12921:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788863808.831388:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba9ca 00000020:00000080:3.0:1788863808.831393:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bff2cd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788863808.831401:0:12921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788863808.831405:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863808.831409:0:12921:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788863808.831412:0:12921:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8e8bff71cd40) has no exports 00000020:00000080:3.0:1788863808.831417:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba9c3 00000020:00000080:3.0:1788863808.831419:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bff2cf800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788863808.831947:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bd23db800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788863808.831966:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bd23da000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788863808.831973:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bd23dd800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788863808.831993:0:36:0:(genops.c:885:class_export_put()) final put ffff8e8bd23dc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788863808.831995:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bd23dc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788863808.832001:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788863808.832098:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bff2cd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788863808.832104:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bff2cf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788863808.833032:0:12921:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788863808.833038:0:12921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788863808.833042:0:12921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788863808.833050:0:12921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788863808.833052:0:12921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788863808.833135:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863808.833146:0:12921:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788863808.833187:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863808.833191:0:12921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788863808.833195:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bc2ee8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788863808.833200:0:12921:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bc2ee8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788863808.833218:0:12921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788863808.833403:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba87a 00000020:00000080:3.0:1788863808.833410:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bee564800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788863808.834119:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bff2c8800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788863808.834127:0:36:0:(genops.c:885:class_export_put()) final put ffff8e8bff2ca000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788863808.834130:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bff2ca000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788863808.834137:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788863808.834338:0:12921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788863808.834345:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863808.834354:0:12921:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788863808.834359:0:12921:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8e8bee4899c0) has no exports 00000020:00000080:3.0:1788863808.834389:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863808.834395:0:12921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788863808.834403:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba881 00000020:00000080:3.0:1788863808.834408:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bee562800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788863808.834417:0:12921:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8bd56cb800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788863808.834421:0:12921:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8bd56cb800 3 00000020:01000004:3.0:1788863808.834424:0:12921:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e8bd56cb800 from lustre-MDT0000 00000020:00000080:3.0:1788863808.834443:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863808.834446:0:12921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788863808.834449:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bee560000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788863808.834452:0:12921:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bee560000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788863808.834458:0:12921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:0.0:1788863808.834709:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bee564800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788863808.834714:0:36:0:(genops.c:885:class_export_put()) final put ffff8e8bee560800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788863808.834717:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bee560800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788863808.834720:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788863808.834957:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bee562800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1788863808.835155:0:12921:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788863808.835161:0:12921:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788863808.835165:0:12921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788863808.835169:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863808.835173:0:12921:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788863808.835181:0:12921:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8e8bc7694000 eff03fbe-e653-4192-b926-0416f2048378 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788863808.835187:0:12921:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8e8bd00819c0) has exports, disconnecting them 00000020:00080000:3.0:1788863808.835192:0:12921:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e8bc7694000), last request at 1788863564 00000020:00000080:3.0:1788863808.835222:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba81f 00000020:00010000:3.0:1788863808.835226:0:12921:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e8bc7694000: total 0 00000100:00080000:3.0:1788863808.835230:0:12921:0:(import.c:65:import_set_state_nolock()) ffff8e8bc7690000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788863808.835283:0:12921:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8bc7694000): rc 0 00000020:00080000:3.0:1788863808.835288:0:12921:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8e8bd00819c0) has no exports 00000100:00100000:3.0:1788863808.835359:0:5835:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e8bd5758000:5835] 2 exiting: rc = 0 00000100:00100000:0.0:1788863808.835906:0:5832:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e8bd5758600:5832] 0 exiting: rc = 1 00000020:00010000:1.0:1788863808.836312:0:8442:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e8bc7694000: total 0 00010000:00010000:1.0:1788863808.836357:0:8442:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e8bc7694000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788863808.836394:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bffc16800/0x744cd7666bbbab59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbbab52 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863808.836430:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7b000/0x744cd7666bbbab4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbbab44 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863808.836442:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc166b600/0x744cd7666bbbad74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbbad6d expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863808.836453:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbab83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbbab7c expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863808.836462:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc166ac00/0x744cd7666bbbad82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbbad7b expref: 5 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863808.836478:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8c021c7a00/0x744cd7666bbba937 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbba930 expref: 4 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863808.836900:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8c021c6800/0x744cd7666bbbab2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbbab28 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863808.836911:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bc0030800/0x744cd7666bbbab3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x744cd7666bbbab36 expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863808.836922:0:8442:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e8bc7694000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788863808.836936:0:8442:0:(genops.c:885:class_export_put()) final put ffff8e8bc7694000/eff03fbe-e653-4192-b926-0416f2048378 00010000:00010000:1.0:1788863808.836957:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863808.836960:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863808.836962:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863808.837001:0:5833:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e8bd0e59400:5833] 1 exiting: rc = 0 00000100:00100000:3.0:1788863808.837126:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837136:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837150:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837157:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837162:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837168:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837173:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837178:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837184:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837189:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837194:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837200:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837205:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837221:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837227:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837233:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837238:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837244:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837249:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837254:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837260:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837265:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837271:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837276:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837281:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837286:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837292:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837297:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837302:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837308:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837313:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837326:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837331:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837336:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837340:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837346:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837352:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837366:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837373:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837379:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837385:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837391:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837396:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837402:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837408:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837413:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837417:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837422:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837426:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837431:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837437:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837441:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837447:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837452:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837456:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837461:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837467:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837472:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837477:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837494:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837500:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837505:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837511:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.837517:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788863808.838717:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bc7694000/eff03fbe-e653-4192-b926-0416f2048378 for MGS 00000020:00000080:0.0:1788863808.838779:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bc7690000 for MGS 20000000:01000000:3.0:1788863808.838982:0:12921:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788863808.838986:0:12921:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788863808.842139:0:12921:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8e8bd2318ba0 - data ffff8e8bff942d80/ffff8e8bf4e76c00 00000020:01000000:3.0:1788863808.842298:0:12921:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8e8bd1e9e2a0 - data ffff8e8bdf157510/ffff8e8bc8524c00 00000020:00000080:3.0:1788863808.843409:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba803 00000020:00000080:3.0:1788863808.843420:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bd008e800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788863808.843450:0:12921:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8bd56cb800 from MGS, refs=2 00000020:01000004:3.0:1788863808.843470:0:12921:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8bd56cb800 2 00000020:01000004:3.0:1788863808.843474:0:12921:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e8bd56cb800 from MGS 00000020:00000080:1.0:1788863808.843834:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bd008e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788863808.843964:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863808.843975:0:12921:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788863808.843979:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bc5460000/MGS 00000020:00000080:3.0:1788863808.843981:0:12921:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bc5460000/MGS for MGS 00000020:01000000:3.0:1788863808.843990:0:12921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788863808.844054:0:12921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788863808.844059:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863808.844065:0:12921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788863808.844072:0:12921:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e8beda09800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788863808.844078:0:12921:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8e8bd22499c0) has exports, disconnecting them 00000020:00080000:3.0:1788863808.844082:0:12921:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e8beda09800), last request at 1788863565 00000020:00000080:3.0:1788863808.844087:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba8ce 00000020:00080000:3.0:1788863808.844099:0:12921:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8beda09800): rc 0 00000020:00000080:3.0:1788863808.844103:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8beda09800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788863808.844702:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8beda09800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788863808.871174:0:12921:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788863808.871185:0:12921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788863808.871190:0:12921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788863808.871198:0:12921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863808.871808:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8becca0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788863808.871941:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863808.871953:0:12921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788863808.871959:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8becca7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788863808.871963:0:12921:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8becca7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788863808.871981:0:12921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788863808.872071:0:12921:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8bd56cb800 1 00000020:00000080:3.0:1788863808.872078:0:12921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba7f5 00000020:00000080:3.0:1788863808.872083:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bc5467000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788863808.872096:0:12921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788863808.872101:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863808.872107:0:12921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788863808.872122:0:12921:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8e8bd224cd40) has no exports 00000020:00000080:1.0:1788863808.872223:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bc5467000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788863808.946542:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863808.946568:0:12921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788863808.946574:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bc3166000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788863808.946586:0:12921:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bc3166000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788863808.946598:0:12921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788863808.946883:0:12921:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e8bc3d01800 00000020:01000000:0.0:1788863808.946905:0:12921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788863808.946909:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863808.946915:0:12921:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788863808.946919:0:12921:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8e8bc84b8000) has no exports 00000100:00100000:0.0:1788863808.947002:0:9496:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff8e8bff089a00:9496] 4 exiting: rc = 0 00000100:00100000:3.0:1788863808.952176:0:5842:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff8e8bd5759800:5842] 2 exiting: rc = 0 00000100:00100000:2.0:1788863808.952985:0:5840:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff8e8bd0198c00:5840] 0 exiting: rc = 1 00000100:00100000:2.0:1788863808.953066:0:6707:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff8e8bd01b3200:6707] 3 exiting: rc = 0 00000100:00100000:2.0:1788863808.953139:0:5841:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff8e8bd0895c00:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1788863808.953493:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953520:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953527:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953545:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953554:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953561:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953567:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953573:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953579:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953584:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953590:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953596:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953602:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953607:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953612:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953617:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953622:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953627:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953632:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953637:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953642:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953647:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953652:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953656:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953662:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953666:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953671:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953676:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953695:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953704:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953710:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953715:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953720:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953726:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953731:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953735:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953749:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953753:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953758:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953763:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953768:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953773:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953778:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953783:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953788:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953794:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953800:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953805:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953809:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953815:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953820:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953826:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953831:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953837:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953843:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953848:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953888:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953894:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953900:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953906:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953912:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953917:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953922:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863808.953929:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.963923:0:5843:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e8bc53c5800:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1788863808.966759:0:5844:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e8bc53c4000:5844] 1 exiting: rc = 0 00000100:00100000:3.0:1788863808.966887:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.966899:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.966910:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.966921:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.966930:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.966937:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.966945:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.966951:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.966965:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.966976:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.966983:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.966991:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.966999:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967005:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967011:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967016:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967023:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967029:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967035:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967040:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967045:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967051:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967056:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967062:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967067:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967088:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967094:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967099:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967104:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967110:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967116:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967121:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967141:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967146:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967152:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967157:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967163:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967169:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967174:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967180:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967185:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967193:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967199:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967216:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967222:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967238:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967245:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967251:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967257:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967262:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967268:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967273:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967279:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967285:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967291:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967297:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967302:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967309:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967318:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967325:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967332:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967339:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967346:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.967353:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.968548:0:5846:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff8e8bc2ee0400:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1788863808.968594:0:5845:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff8e8bd08a7600:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1788863808.968654:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.968676:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.968696:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.968707:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.968714:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.968722:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969406:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969415:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969429:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969441:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969453:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969465:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969472:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969673:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969683:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969691:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969697:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969704:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969711:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969717:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969723:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969809:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969816:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969822:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969830:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969877:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969888:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969897:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969906:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969914:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969924:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969933:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969941:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969952:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969960:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969969:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.969981:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970027:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970039:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970051:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970063:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970072:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970078:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970092:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970100:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970108:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970115:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970122:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970129:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970154:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970163:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970172:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970183:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970193:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970203:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970222:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970229:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970235:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970243:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970251:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970260:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970290:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970299:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863808.970309:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.015105:0:5848:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e8bc2ee0c00:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1788863809.015925:0:5847:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e8bc2ee0800:5847] 0 exiting: rc = 1 00000100:00100000:0.0:1788863809.017471:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.017495:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.017509:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.017519:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.017531:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018143:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018153:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018163:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018175:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018184:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018194:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018215:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018227:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018239:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018250:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018260:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018292:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018303:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018313:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018323:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018332:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018342:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018350:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018360:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018370:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018396:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018406:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018417:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018425:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018435:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018444:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018455:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018465:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018478:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018489:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018500:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018511:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018521:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.018530:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019000:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019021:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019026:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019032:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019038:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019044:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019050:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019055:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019060:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019066:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019071:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019689:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019697:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019703:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019708:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019714:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019720:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019725:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019730:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019735:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019740:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019745:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019750:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019755:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.019760:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863809.021802:0:5850:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e8bc2ee1400:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1788863809.022128:0:5849:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e8bc2ee0600:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1788863809.023497:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023507:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023512:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023517:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023522:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023527:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023544:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023549:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023555:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023561:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023583:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023615:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023620:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023625:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023630:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023636:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023641:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023646:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023651:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023656:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023661:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023666:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023672:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023677:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023691:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023698:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023704:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023709:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023715:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023721:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023726:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023732:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023738:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023743:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023748:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023754:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023759:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023764:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023769:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023775:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023780:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023786:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023792:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023796:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023802:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023806:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023818:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023823:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023828:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023833:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023838:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023843:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023848:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023882:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023886:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023891:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023904:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023910:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023914:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023919:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023923:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023928:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023932:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.023937:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.024843:0:5852:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e8bd575ae00:5852] 1 exiting: rc = 0 00000100:00100000:2.0:1788863809.025053:0:5851:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e8bc2ee0e00:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1788863809.025363:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.025415:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.025428:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.025438:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.025448:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.025458:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.025468:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.025476:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.025486:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.025497:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.025505:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.025513:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.025522:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026629:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026672:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026705:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026721:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026770:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026784:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026799:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026811:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026820:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026831:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026843:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026918:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026929:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026941:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026953:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026964:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026974:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026986:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.026995:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027004:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027011:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027016:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027021:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027026:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027031:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027036:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027044:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027055:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027066:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027074:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027084:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027095:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027106:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027120:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027134:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027146:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027157:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027168:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.027179:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.028034:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.028057:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.028064:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.028072:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.028079:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.028086:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.028093:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.028099:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.028104:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.028109:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.028114:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863809.028119:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863809.032797:0:5854:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff8e8bd08a7000:5854] 1 exiting: rc = 0 00000100:00100000:2.0:1788863809.033629:0:5853:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff8e8bd565fa00:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1788863809.034739:0:5855:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff8e8bc7980a00:5855] 2 exiting: rc = 0 00000100:00100000:1.0:1788863809.037021:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037043:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037052:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037059:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037065:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037074:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037080:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037089:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037097:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037105:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037114:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037133:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037142:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037149:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037155:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037162:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037170:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037177:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037184:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037190:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037196:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037201:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037217:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037223:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037229:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037235:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037258:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037265:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037479:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037490:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037497:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037503:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037510:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037517:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037525:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037555:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037565:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037572:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037579:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037586:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037594:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037601:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037609:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037616:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037623:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037630:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037638:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037644:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037650:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037657:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037665:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037673:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037681:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037779:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037791:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037797:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037803:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037810:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037816:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037839:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037848:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037939:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037945:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863809.037952:0:12921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788863809.045326:0:12921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863809.045343:0:12921:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788863809.045349:0:12921:0:(genops.c:885:class_export_put()) final put ffff8e8bc7696800/MDS_uuid 00000020:00000080:1.0:1788863809.045354:0:12921:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bc7696800/MDS_uuid for MDS 00000020:01000000:1.0:1788863809.045368:0:12921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788863809.045510:0:12921:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788863809.494083:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788863809.727345:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788863809.727364:0:6708:0:(genops.c:885:class_export_put()) final put ffff8e8beda4a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788863809.727497:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8beda4a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788863809.727601:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8beda4e000 for lustre-OST0000 00010000:00010000:2.0:1788863810.518386:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863811.550576:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863812.573145:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788863812.614526:0:13074:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788863812.639704:0:13074:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788863812.639780:0:13074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863812.639800:0:13074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863812.639809:0:13074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863812.639816:0:13074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863812.640314:0:13074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788863812.640325:0:13074:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788863812.640402:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863812.640411:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863812.640420:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8c021c6600 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:2.0:1788863812.640425:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863812.640435:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863812.640442:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863812.640448:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788863812.640451:0:8443:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788863812.640454:0:8443:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788863812.640517:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863812.640542:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863812.640589:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863812.640597:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6600/0x744cd7666bbbab44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbab4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863812.640613:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863812.640615:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863812.640617:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863812.640633:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759324026240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863812.640729:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788863812.641370:0:13074:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788863812.641376:0:13074:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788863812.641383:0:13074:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788863812.641389:0:13074:0:(import.c:65:import_set_state_nolock()) ffff8e8bff594800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788863812.641395:0:13074:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788863812.641406:0:13074:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788863812.641410:0:13074:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788863812.645805:0:13074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863812.645829:0:13074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863812.645837:0:13074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863812.645845:0:13074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863812.645892:0:13074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788863812.645959:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324026240 00000100:00100000:2.0:1788863812.645969:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324026240 00010000:00010000:1.0:1788863812.646000:0:13074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863812.646007:0:13074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863812.646013:0:13074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863812.646019:0:13074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863812.646020:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788863812.646028:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3308:x1875759324026240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863812.646029:0:13074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788863812.646033:0:13074:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00020000:2.0:1788863812.646035:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788863812 with bad export cookie 8380309841523746847 00000020:01000004:1.0:1788863812.646054:0:13074:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788863812.646058:0:13074:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788863812.646075:0:13074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863812.646081:0:13074:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788863812.646085:0:13074:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8e8bd224b380) has no exports 00000020:00080000:1.0:1788863812.646110:0:13074:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8e8bd224b380) has no exports 00010000:00010000:3.0:1788863812.646660:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788863812.646669:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863812.646684:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a000 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863812.646689:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863812.646698:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863812.646706:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863812.646712:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788863812.646714:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788863812.646717:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788863812.646760:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863812.646766:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863812.646802:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863812.646810:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbab52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbab59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863812.646823:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863812.646827:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863812.646832:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16a00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863812.646835:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863812.646847:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863812.646870:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863812.646875:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788863812.646878:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788863812.646880:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788863812.646893:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863812.646898:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863812.646915:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863812.646922:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbad7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x744cd7666bbbad82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863812.646932:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863812.646933:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863812.646935:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863812.646942:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863812.646956:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324026496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863812.647032:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863812.647101:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324026496 00000100:00100000:3.0:1788863812.647106:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324026496 00000100:00100000:3.0:1788863812.647146:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788863812.647152:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1875759324026496:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788863812.647164:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788863812 with bad export cookie 8380309841523746847 00000100:00100000:3.0:1788863812.647207:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1875759324026496:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (175us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788863812.647214:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788863812.647255:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788863812.647261:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8e8bc7693000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788863812.647266:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:1.0:1788863812.654303:0:13074:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8e8bd57b00c0 - data ffff8e8be946f5e8/ffff8e8bee37ac00 00000020:01000000:1.0:1788863812.654495:0:13074:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8e8bd1d25780 - data ffff8e8bff840438/ffff8e8bff25b800 00000100:00100000:2.0:1788863812.655275:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3308:x1875759324026240:12345-0@lo:103:ldlm_bl.0 Request processed in 9238us (14537us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788863812.655292:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788863812.661766:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788863812.670475:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.151@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788863812.670482:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788863812.670495:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8bca961f80 x1875759324026240/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788863828 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863812.670847:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8bffcfd500 x1875759324026496/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788863828 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788863812.670893:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788863812.670896:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788863812.670897:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788863812.674130:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eff03fbe-e653-4192-b926-0416f2048378:0:1875759324026368:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788863812.676049:0:3308:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e8bc7693000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1788863812.676079:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eff03fbe-e653-4192-b926-0416f2048378:3308:1875759324026240:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788863812.676153:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8e8bc7693000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788863812.676159:0:3306:0:(import.c:545:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 193 00000100:00080000:3.0:1788863812.676174:0:3306:0:(import.c:666:import_select_connection()) MGC192.168.204.151@tcp: import ffff8e8bc7693000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788863812.676210:0:3306:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bffcff100 x1875759324026624/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788863812.676240:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eff03fbe-e653-4192-b926-0416f2048378:3306:1875759324026496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863812.676910:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eff03fbe-e653-4192-b926-0416f2048378:3305:1875759324026624:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1788863812.676962:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875759324026624 offset 0 length 520: 4 00100000:10000000:2.0:1788863812.692177:0:13074:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788863812.739793:0:13074:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba953 00000020:00000080:2.0:1788863812.739806:0:13074:0:(genops.c:885:class_export_put()) final put ffff8e8bf6757000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788863812.739824:0:13074:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8bde7ad800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788863812.739828:0:13074:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8bde7ad800 2 00000020:01000004:2.0:1788863812.739833:0:13074:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e8bde7ad800 from lustre-OST0000 00000020:00000080:2.0:1788863812.739910:0:13074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863812.739921:0:13074:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788863812.739924:0:13074:0:(genops.c:885:class_export_put()) final put ffff8e8bf6752800/lustre-OST0000_UUID 00000020:00000080:2.0:1788863812.739927:0:13074:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bf6752800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788863812.739936:0:13074:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788863812.739986:0:13074:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788863812.739991:0:13074:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788863812.739996:0:13074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788863812.740001:0:13074:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788863812.740007:0:13074:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e8bff592800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788863812.740013:0:13074:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8e8bd2248000) has exports, disconnecting them 00000020:00080000:2.0:1788863812.740018:0:13074:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e8bff592800), last request at 1788863584 00000020:00000080:2.0:1788863812.740022:0:13074:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba97d 00000020:00080000:2.0:1788863812.740033:0:13074:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8bff592800): rc 0 00000020:00000080:2.0:1788863812.740038:0:13074:0:(genops.c:885:class_export_put()) final put ffff8e8bff592800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788863812.740535:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bf6757000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788863812.740551:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bff592800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788863812.758974:0:13074:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788863812.758988:0:13074:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788863812.758994:0:13074:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788863812.759004:0:13074:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863812.759143:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bff594800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788863812.759380:0:13074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863812.759389:0:13074:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788863812.759395:0:13074:0:(genops.c:885:class_export_put()) final put ffff8e8bff590800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788863812.759399:0:13074:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bff590800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788863812.759408:0:13074:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788863812.759474:0:13074:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8bde7ad800 1 00000020:00000080:0.0:1788863812.759481:0:13074:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba90d 00000020:00000080:0.0:1788863812.759487:0:13074:0:(genops.c:885:class_export_put()) final put ffff8e8bde7a9800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788863812.759504:0:13074:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788863812.759510:0:13074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863812.759515:0:13074:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788863812.759520:0:13074:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8e8bd0080000) has no exports 00000020:00000080:1.0:1788863812.759638:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bde7a9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788863812.789090:0:13074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863812.789115:0:13074:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788863812.789122:0:13074:0:(genops.c:885:class_export_put()) final put ffff8e8bde7a8000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788863812.789128:0:13074:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bde7a8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788863812.789148:0:13074:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788863812.789359:0:13074:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e8bde7ac800 00000020:02000400:1.0:1788863812.789423:0:13074:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788863813.591201:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788863813.727883:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) eff03fbe-e653-4192-b926-0416f2048378->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863813.727897:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) eff03fbe-e653-4192-b926-0416f2048378->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863813.727901:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863813.727905:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863813.727910:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2ce800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863813.727922:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 437 00000100:00080000:1.0:1788863813.727930:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788863813.727949:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e8bff2ce800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788863813.728011:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bc8517100 x1875759324026752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863813.728690:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875759324026752:0@lo:38:kworker.0 00000400:00000100:0.0:1788863813.728767:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759324026752 offset 0 length 520: 4 00010000:00010000:2.0:1788863814.614413:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863815.639044:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788863816.389794:0:13224:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788863816.407054:0:13224:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788863816.407171:0:13224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.407189:0:13224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.407197:0:13224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.407204:0:13224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.407228:0:13224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788863816.407233:0:13224:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788863816.407254:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788863816.407268:0:13224:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8bc8517100 x1875759324026752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863828 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863816.407288:0:13224:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788863816.407293:0:13224:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788863816.407299:0:13224:0:(import.c:65:import_set_state_nolock()) ffff8e8bff2ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788863816.407304:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788863816.407307:0:13224:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8bc8517100 x1875759324026752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863828 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863816.407313:0:13224:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788863816.407316:0:13224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1788863816.407558:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875759324026752:0@lo:38:kworker.0 00010000:00010000:0.0:1788863816.407645:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863816.407653:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863816.407662:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bc0030400 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:0.0:1788863816.407665:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863816.407677:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863816.407685:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863816.407691:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788863816.407694:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788863816.407697:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788863816.407717:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8bc7693000 00010000:00010000:0.0:1788863816.407721:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863816.407727:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bc0030400/0x744cd7666bbbab28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x744cd7666bbbab2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863816.407739:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863816.407741:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863816.407742:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863816.409149:0:13224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.409168:0:13224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.409175:0:13224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.409181:0:13224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.409202:0:13224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863816.409208:0:13224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.409215:0:13224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.409220:0:13224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.409226:0:13224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.410208:0:13224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788863816.410219:0:13224:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788863816.410255:0:13224:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788863816.410262:0:13224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788863816.410268:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863816.410279:0:13224:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788863816.410301:0:13224:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8e8bee48b380) has no exports 00000020:00080000:1.0:1788863816.410331:0:13224:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8e8bee48b380) has no exports 00010000:00010000:0.0:1788863816.412123:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788863816.412169:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863816.412184:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8c021c6200 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:0.0:1788863816.412188:0:8442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863816.412201:0:8442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863816.412208:0:8442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863816.412214:0:8442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788863816.412217:0:8442:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788863816.412220:0:8442:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788863816.412247:0:8442:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8bc7693000 00010000:00010000:0.0:1788863816.412251:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863816.412257:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8c021c6200/0x744cd7666bbbab36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x744cd7666bbbab3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863816.412277:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863816.412282:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863816.412287:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17c00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:0.0:1788863816.412289:0:8442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863816.412307:0:8442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863816.412314:0:8442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863816.412319:0:8442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788863816.412321:0:8442:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788863816.412323:0:8442:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788863816.412329:0:8442:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8bc7693000 00010000:00010000:0.0:1788863816.412332:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863816.412338:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17c00/0x744cd7666bbbad6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x744cd7666bbbad74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863816.412355:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863816.412357:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863816.412359:0:8442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863816.414913:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788863816.420310:0:13224:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8e8bf444e2a0 - data ffff8e8be9423d80/ffff8e8bd0fed400 00000020:01000000:1.0:1788863816.420490:0:13224:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8e8bd57b0660 - data ffff8e8bff9410d8/ffff8e8bffdc9000 00100000:10000000:1.0:1788863816.459551:0:13224:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788863816.505133:0:13224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbaa1e 00000020:00000080:1.0:1788863816.505146:0:13224:0:(genops.c:885:class_export_put()) final put ffff8e8bd23de000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788863816.505169:0:13224:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8bd2b49800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788863816.505173:0:13224:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8bd2b49800 2 00000020:01000004:1.0:1788863816.505178:0:13224:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e8bd2b49800 from lustre-OST0001 00000020:00000080:3.0:1788863816.505205:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bd23de000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788863816.505210:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863816.505225:0:13224:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788863816.505229:0:13224:0:(genops.c:885:class_export_put()) final put ffff8e8bd23df000/lustre-OST0001_UUID 00000020:00000080:1.0:1788863816.505231:0:13224:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bd23df000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788863816.505245:0:13224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788863816.505590:0:13224:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import eff03fbe-e653-4192-b926-0416f2048378->MGS 00010000:00010000:1.0:1788863816.505610:0:13224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7400/0x744cd7666bbba930 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbba937 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863816.505623:0:13224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7400/0x744cd7666bbba930 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbba937 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863816.505630:0:13224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788863816.505633:0:13224:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788863816.505636:0:13224:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788863816.505651:0:13224:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8bc7693000 00010000:00010000:1.0:1788863816.505653:0:13224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8c021c7400/0x744cd7666bbba930 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x744cd7666bbba937 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863816.505670:0:13224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16600/0x744cd7666bbbab7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x744cd7666bbbab83 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863816.505689:0:13224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16600/0x744cd7666bbbab7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x744cd7666bbbab83 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863816.505695:0:13224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788863816.505698:0:13224:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788863816.505699:0:13224:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788863816.505709:0:13224:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8bc7693000 00010000:00010000:1.0:1788863816.505711:0:13224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16600/0x744cd7666bbbab7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x744cd7666bbbab83 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788863816.505727:0:13224:0:(import.c:65:import_set_state_nolock()) ffff8e8bc7693000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788863816.505732:0:13224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788863816.505734:0:13224:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788863816.505736:0:13224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788863816.505741:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788863816.505753:0:13224:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8bffcff100 x1875759324026624/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788863822 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788863816.505776:0:13224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788863816.505779:0:13224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1788863816.505933:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eff03fbe-e653-4192-b926-0416f2048378:3305:1875759324026624:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:1.0:1788863816.506147:0:13224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788863816.506155:0:13224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba811 00000020:00000080:1.0:1788863816.506161:0:13224:0:(genops.c:885:class_export_put()) final put ffff8e8bc7691800/eff03fbe-e653-4192-b926-0416f2048378 00000020:01000000:1.0:1788863816.506176:0:13224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.151@tcp (flags='') 00000020:00000080:1.0:1788863816.506181:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863816.506187:0:13224:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788863816.506191:0:13224:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8e8bc84bb380) has no exports 10000000:01000000:0.0:1788863816.506295:0:5838:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788863816.506309:0:13224:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.204.151@tcp: client import never connected 00000100:00080000:1.0:1788863816.506311:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788863816.506313:0:13224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788863816.506315:0:13224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788863816.506323:0:13224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788863816.506354:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863816.506360:0:13224:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.151@tcp (uuid eff03fbe-e653-4192-b926-0416f2048378) 00000020:01000000:1.0:1788863816.506364:0:13224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788863816.506367:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863816.506371:0:13224:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788863816.506376:0:13224:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e8beddcf800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788863816.506380:0:13224:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8e8bff71b380) has exports, disconnecting them 00000020:00000080:3.0:1788863816.506382:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bc7691800/eff03fbe-e653-4192-b926-0416f2048378 for MGC192.168.204.151@tcp 00000020:00080000:1.0:1788863816.506384:0:13224:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e8beddcf800), last request at 1788863605 00000020:00000080:1.0:1788863816.506388:0:13224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbbaa48 00000020:00000080:3.0:1788863816.506390:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bc7693000 for MGC192.168.204.151@tcp 00000020:00080000:1.0:1788863816.506398:0:13224:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8beddcf800): rc 0 00000020:00000080:3.0:1788863816.506400:0:36:0:(genops.c:885:class_export_put()) final put ffff8e8bc5463000/eff03fbe-e653-4192-b926-0416f2048378 00000020:00000080:3.0:1788863816.506402:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bc5463000/eff03fbe-e653-4192-b926-0416f2048378 for MGC192.168.204.151@tcp 00000020:01000000:3.0:1788863816.506406:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.151@tcp (eff03fbe-e653-4192-b926-0416f2048378) 00000020:00000080:1.0:1788863816.506412:0:13224:0:(genops.c:885:class_export_put()) final put ffff8e8beddcf800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788863816.506687:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8beddcf800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788863816.507924:0:13224:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788863816.507929:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788863816.507937:0:13224:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788863816.507942:0:13224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788863816.511171:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e8bff2ce800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788863816.511211:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788863816.518368:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788863816.522926:0:8442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788863816.523208:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788863816.523607:0:5824:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e8bc7775a00:5824] 1 exiting: rc = 0 00000100:00100000:3.0:1788863816.523671:0:5823:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e8bcf167a00:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1788863816.523931:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863816.524181:0:5825:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e8bc7775e00:5825] 0 exiting: rc = 1 00000100:00100000:3.0:1788863816.524247:0:5826:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e8bc7775800:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1788863816.524503:0:5827:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e8bc7774400:5827] 2 exiting: rc = 0 00000100:00100000:2.0:1788863816.524565:0:8500:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e8bc7373000:8500] 3 exiting: rc = 0 00000100:00100000:0.0:1788863816.524606:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524625:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524632:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524644:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524651:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524657:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524664:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524671:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524677:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524684:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524691:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524697:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524703:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524714:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524722:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524729:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524737:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524743:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524749:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524754:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524759:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524765:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524770:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524775:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524781:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524791:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524797:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524802:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524807:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524812:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524818:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524824:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524828:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524834:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524838:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524844:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524879:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.524885:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.533922:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.533971:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.533977:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.533983:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.533989:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.533994:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.533999:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.534005:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.534010:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.534015:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.534020:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.534026:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.534032:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.534037:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.534043:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.534047:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.534053:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.534071:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.535723:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.535746:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.535751:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.535757:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.535766:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.535771:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.535777:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.535783:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788863816.543730:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863816.543747:0:13224:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788863816.543754:0:13224:0:(genops.c:885:class_export_put()) final put ffff8e8bf4c44800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788863816.543759:0:13224:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bf4c44800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788863816.543777:0:13224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788863816.543872:0:13224:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8bd2b49800 1 00000020:00000080:0.0:1788863816.543895:0:13224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x744cd7666bbba9ed 00000020:00000080:0.0:1788863816.543903:0:13224:0:(genops.c:885:class_export_put()) final put ffff8e8bff21e800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788863816.543920:0:13224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788863816.543925:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863816.543930:0:13224:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788863816.543934:0:13224:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8e8bff7199c0) has no exports 00000020:00000080:3.0:1788863816.544260:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bff21e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788863816.617182:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863816.617206:0:13224:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788863816.617214:0:13224:0:(genops.c:885:class_export_put()) final put ffff8e8bd2b4b000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788863816.617221:0:13224:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bd2b4b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788863816.617241:0:13224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788863816.617547:0:13224:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e8bd2b4d000 00000020:01000000:0.0:1788863816.617577:0:13224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788863816.617581:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863816.617586:0:13224:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788863816.617590:0:13224:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8e8bd0084d40) has no exports 00000020:00000080:0.0:1788863816.617618:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863816.617625:0:13224:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788863816.617628:0:13224:0:(genops.c:885:class_export_put()) final put ffff8e8bde7ac000/OSS_uuid 00000020:00000080:0.0:1788863816.617630:0:13224:0:(genops.c:844:class_export_destroy()) destroying export ffff8e8bde7ac000/OSS_uuid for OSS 00000020:01000000:0.0:1788863816.617634:0:13224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788863816.617724:0:6679:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff8e8bd01b0000:6679] 1 exiting: rc = 0 00000100:00100000:0.0:1788863816.617836:0:12016:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff8e8bd2334a00:12016] 4 exiting: rc = 0 00000100:00100000:3.0:1788863816.620471:0:10277:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff8e8bfb59fc00:10277] 3 exiting: rc = 0 00000100:00080000:2.0:1788863816.623612:0:5836:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788863816.623927:0:6680:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff8e8bd01b1c00:6680] 2 exiting: rc = 0 00000100:00100000:2.0:1788863816.624183:0:6677:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff8e8bd01b1200:6677] 0 exiting: rc = 1 00000100:00100000:0.0:1788863816.625428:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625441:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625448:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625456:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625463:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625468:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625474:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625480:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625486:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625493:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625498:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625520:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625525:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625533:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625539:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625544:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625549:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625555:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625561:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625567:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625573:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625579:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625585:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625591:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625596:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625602:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625607:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625612:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625617:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625623:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625628:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625634:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625639:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625645:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625651:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625656:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625661:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625666:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625673:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625678:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625684:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625690:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625695:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625701:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625707:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625711:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625725:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625731:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625737:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625743:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625748:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625769:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625776:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625782:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625788:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625794:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625799:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625807:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625812:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625818:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625823:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625831:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625837:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.625842:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.627230:0:6681:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e8bf448fc00:6681] 0 exiting: rc = 1 00000100:00100000:0.0:1788863816.629250:0:6682:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e8bf447b000:6682] 1 exiting: rc = 0 00000100:00100000:1.0:1788863816.629563:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629577:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629583:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629589:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629593:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629599:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629604:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629610:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629615:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629621:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629625:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629631:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629636:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629641:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629647:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629653:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629659:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629664:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629670:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629688:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629693:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629700:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629705:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629710:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629715:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629721:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629726:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629731:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629736:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629748:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629757:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629762:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629768:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629773:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629784:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629790:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629795:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629800:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629805:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629810:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629815:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629820:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629826:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629832:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629837:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629842:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629847:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629873:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629879:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629885:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629894:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629900:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629905:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629910:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629922:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629928:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629933:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629939:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629944:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629949:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629955:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629980:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629987:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.629993:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.631029:0:6684:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e8bf448cc00:6684] 1 exiting: rc = 0 00000100:00100000:0.0:1788863816.631364:0:6685:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e8bf448c800:6685] 2 exiting: rc = 0 00000100:00100000:0.0:1788863816.631614:0:6683:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e8bf448c000:6683] 0 exiting: rc = 1 00000100:00100000:1.0:1788863816.632036:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632048:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632066:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632073:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632082:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632089:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632095:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632102:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632108:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632117:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632123:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632129:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632138:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632144:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632150:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632155:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632161:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632167:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632173:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632179:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632186:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632193:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632200:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632206:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632229:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632249:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632255:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632261:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632267:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632274:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632280:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632287:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632292:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632300:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632307:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632313:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632319:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632326:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632333:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632340:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632347:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632355:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632362:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632370:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632375:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632382:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632388:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632394:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632402:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632408:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632414:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632422:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632445:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632454:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632459:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632465:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632474:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632480:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632487:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632502:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632507:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632513:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632519:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.632534:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.649277:0:6686:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e8bf447e400:6686] 0 exiting: rc = 1 00000100:00100000:1.0:1788863816.651552:0:6687:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e8bf447f400:6687] 1 exiting: rc = 0 00000100:00100000:0.0:1788863816.651739:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651750:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651757:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651763:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651769:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651775:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651780:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651785:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651791:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651796:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651801:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651807:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651837:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651843:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651877:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651884:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651890:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651896:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651902:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651907:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651913:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651918:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651924:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651930:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651936:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651943:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651949:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651954:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651961:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651966:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651983:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651989:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.651994:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652000:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652005:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652010:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652016:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652021:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652026:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652032:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652038:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652044:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652049:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652065:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652075:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652080:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652086:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652100:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652106:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652112:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652124:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652130:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652135:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652140:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652147:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652152:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652156:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652161:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652166:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652172:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652177:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652182:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652186:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.652192:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863816.654286:0:6688:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e8bd01b0400:6688] 0 exiting: rc = 1 00000100:00100000:0.0:1788863816.674417:0:6689:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e8bd01b1a00:6689] 1 exiting: rc = 0 00000100:00100000:1.0:1788863816.674881:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674890:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674896:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674902:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674908:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674913:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674919:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674924:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674944:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674952:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674958:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674964:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674970:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674989:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.674996:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675003:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675011:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675020:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675027:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675034:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675069:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675076:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675083:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675089:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675097:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675104:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675111:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675117:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675123:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675145:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675151:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675158:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675181:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675193:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675208:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675215:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675222:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675228:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675234:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675240:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675247:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675254:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675260:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675266:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675287:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675296:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675302:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675309:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675316:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675322:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675327:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675333:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675340:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675346:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675353:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675359:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675382:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675390:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675396:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675403:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675410:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675426:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675433:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863816.675439:0:13224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788863816.691683:0:13224:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788863834.953180:0:13840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788863844.408502:0:14300:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788863844.408517:0:14300:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788863844.408668:0:14300:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e8bfb3af800 00000020:01000004:0.0:1788863844.408694:0:14300:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788863844.408707:0:14300:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788863844.408730:0:14300:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e8bc84bcd40) 00000020:00000080:0.0:1788863844.408752:0:14300:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788863844.424382:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788863844.427032:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788863844.427487:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:0.0:1788863844.428017:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788863844.428078:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:0.0:1788863844.428163:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:0.0:1788863844.428247:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:0.0:1788863844.428338:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:0.0:1788863844.428750:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:0.0:1788863844.429201:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:0.0:1788863844.430841:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 282: rc = 0 00100000:10000000:0.0:1788863844.430997:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 282: rc = 0 00100000:10000000:0.0:1788863844.432006:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 496: rc = 0 00100000:10000000:0.0:1788863844.432559:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 496: rc = 0 00100000:10000000:0.0:1788863844.432919:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 496: rc = 0 00100000:10000000:0.0:1788863844.433848:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 496: rc = 0 00100000:10000000:0.0:1788863844.434386:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 496: rc = 0 00100000:10000000:0.0:1788863844.434673:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 496: rc = 0 00100000:10000000:1.0:1788863844.435215:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 496: rc = 0 00100000:10000000:1.0:1788863844.435614:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 496: rc = 0 00100000:10000000:1.0:1788863844.436029:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 496: rc = 0 00100000:10000000:1.0:1788863844.436486:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 496: rc = 0 00100000:10000000:1.0:1788863844.437088:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 496: rc = 0 00100000:10000000:1.0:1788863844.437379:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 496: rc = 0 00100000:10000000:1.0:1788863844.438231:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 733: rc = 0 00100000:10000000:1.0:1788863844.438616:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 733: rc = 0 00100000:10000000:1.0:1788863844.439098:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 733: rc = 0 00100000:10000000:1.0:1788863844.439387:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 733: rc = 0 00100000:10000000:1.0:1788863844.439789:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 733: rc = 0 00100000:10000000:1.0:1788863844.440158:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 733: rc = 0 00100000:10000000:1.0:1788863844.440421:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 733: rc = 0 00100000:10000000:1.0:1788863844.441064:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 733: rc = 0 00100000:10000000:1.0:1788863844.441387:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 733: rc = 0 00100000:10000000:1.0:1788863844.441805:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 733: rc = 0 00100000:10000000:1.0:1788863844.442258:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 733: rc = 0 00100000:10000000:1.0:1788863844.442643:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 733: rc = 0 00100000:10000000:1.0:1788863844.443769:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 733: rc = 0 00100000:10000000:1.0:1788863844.444113:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 733: rc = 0 00100000:10000000:1.0:1788863844.444424:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 733: rc = 0 00100000:10000000:1.0:1788863844.444744:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 733: rc = 0 00100000:10000000:1.0:1788863844.445096:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 733: rc = 0 00100000:10000000:1.0:1788863844.445396:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 733: rc = 0 00100000:10000000:1.0:1788863844.445713:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 733: rc = 0 00100000:10000000:1.0:1788863844.446377:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 733: rc = 0 00100000:10000000:1.0:1788863844.446774:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 733: rc = 0 00100000:10000000:1.0:1788863844.447144:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 733: rc = 0 00100000:10000000:1.0:1788863844.447608:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 733: rc = 0 00100000:10000000:1.0:1788863844.447974:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 733: rc = 0 00100000:10000000:1.0:1788863844.448259:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 733: rc = 0 00100000:10000000:1.0:1788863844.448766:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 733: rc = 0 00100000:10000000:1.0:1788863844.449086:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 733: rc = 0 00100000:10000000:1.0:1788863844.449382:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 733: rc = 0 00100000:10000000:1.0:1788863844.449785:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 733: rc = 0 00100000:10000000:1.0:1788863844.450177:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 733: rc = 0 00100000:10000000:1.0:1788863844.450459:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 733: rc = 0 00100000:10000000:1.0:1788863844.450846:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 733: rc = 0 00100000:10000000:1.0:1788863844.451502:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 289: rc = 0 00100000:10000000:1.0:1788863844.452336:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788863844.452889:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 492: rc = 0 00100000:10000000:1.0:1788863844.453119:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788863844.453187:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 492: rc = 0 00100000:10000000:1.0:1788863844.453417:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788863844.453482:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 492: rc = 0 00100000:10000000:1.0:1788863844.454143:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788863844.454209:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 283: rc = 0 00100000:10000000:1.0:1788863844.454412:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788863844.454480:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 283: rc = 0 00100000:10000000:1.0:1788863844.454791:0:14300:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788863844.454957:0:14300:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 283: rc = 0 00000020:00000080:1.0:1788863844.455340:0:14300:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788863844.455354:0:14300:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788863844.455371:0:14300:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbbbb04 00000020:01000004:1.0:1788863844.455382:0:14300:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788863844.455390:0:14300:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788863844.455398:0:14300:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8bfb3af800 from MGS 00000020:01000004:1.0:1788863844.455403:0:14300:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788863844.455416:0:14300:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e8bff033380) 00000020:00000080:1.0:1788863844.455428:0:14300:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788863844.455503:0:14300:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8bfb3af800 from MGS, refs=2 00080000:01000000:1.0:1788863844.455595:0:14300:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788863844.455604:0:14300:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbbbb12 00000100:00100000:1.0:1788863844.455736:0:14300:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788863844.456008:0:14300:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788863844.456016:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788863844.456757:0:14300:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788863844.456765:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788863844.457663:0:14300:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863844.458081:0:14300:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788863844.458087:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788863844.458695:0:14300:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788863844.458702:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788863844.459079:0:14300:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788863844.459086:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788863844.459996:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863844.460001:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863844.460003:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863844.460355:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863844.460357:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863844.460359:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863844.461015:0:14300:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788863844.463199:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788863844.475167:0:14300:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788863844.475194:0:14300:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788863844.475198:0:14300:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788863844.483268:0:14309:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788863844.483457:0:14300:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788863844.484381:0:14300:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788863844.490161:0:14300:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788863844.490617:0:14300:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863844.490903:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788863844.490911:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788863844.495565:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788863844.495588:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788863844.499162:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788863844.499191:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788863844.502872:0:14314:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788863844.503964:0:14300:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788863844.504006:0:14300:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.151@tcp' 00000020:01000004:0.0:1788863844.504008:0:14300:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788863844.504048:0:14300:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.151@tcp (typ=mgc) 00000020:00000080:0.0:1788863844.504071:0:14300:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.151@tcp (ffff8e8bc84b99c0) 00000020:00000080:0.0:1788863844.504115:0:14300:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788863844.505546:0:14300:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8bc7e1e000@MGC192.168.204.151@tcp: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1788863844.505744:0:14300:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.151@tcp-0 is initialized 00000040:01000000:0.0:1788863844.505752:0:14300:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788863844.510864:0:14316:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788863844.510959:0:14300:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.151@tcp (uuid 98ce9f4a-6069-439b-828d-fac2605e9de4) 00000020:00000080:0.0:1788863844.511009:0:14300:0:(genops.c:1384:class_connect()) connect: client 98ce9f4a-6069-439b-828d-fac2605e9de4, cookie 0x744cd7666bbbbb20 00000100:00080000:0.0:1788863844.511026:0:14300:0:(import.c:545:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788863844.511047:0:14300:0:(import.c:666:import_select_connection()) MGC192.168.204.151@tcp: import ffff8e8bc7e1e000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788863844.511119:0:14300:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bcabdf800 x1875759324026880/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863844.511244:0:14300:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 98ce9f4a-6069-439b-828d-fac2605e9de4->MGS 00000020:01000004:0.0:1788863844.511279:0:14300:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788863844.511287:0:14300:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788863844.511306:0:14300:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e8bc84bb380) 00000020:00000080:0.0:1788863844.511322:0:14300:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788863844.511496:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:98ce9f4a-6069-439b-828d-fac2605e9de4:3305:1875759324026880:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788863844.511636:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863844.511734:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324026880 00000100:00100000:2.0:1788863844.511748:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324026880 00000100:00100000:2.0:1788863844.511805:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863844.511815:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee37b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1875759324026880:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788863844.511873:0:14311:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 98ce9f4a-6069-439b-828d-fac2605e9de4@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:2.0:1788863844.511903:0:14311:0:(genops.c:1384:class_connect()) connect: client 98ce9f4a-6069-439b-828d-fac2605e9de4, cookie 0x744cd7666bbbbb2e 00000100:00080000:2.0:1788863844.512071:0:14311:0:(import.c:65:import_set_state_nolock()) ffff8e8bff595800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788863844.512171:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee37b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+5:3305:x1875759324026880:12345-0@lo:250:mount.lustre.0 Request processed in 355us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863844.512180:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863844.512215:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788863844.512229:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.151@tcp: connect to target with instance 0 00000100:00080000:3.0:1788863844.512239:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788863844.512244:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788863844.512250:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bc7e1e000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788863844.512254:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788863844.512267:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788863844.512275:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:98ce9f4a-6069-439b-828d-fac2605e9de4:3305:1875759324026880:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788863844.519706:0:14300:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863844.520054:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788863844.520062:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788863844.521354:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788863844.521370:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788863844.528918:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788863844.528945:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788863844.531126:0:14300:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788863844.531721:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788863844.531729:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788863844.535653:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788863844.535681:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788863844.593179:0:14300:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788863844.597077:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788863844.597093:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788863844.599256:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788863844.599279:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788863844.602643:0:14300:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788863844.603491:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788863844.603513:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788863844.605685:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788863844.605702:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788863844.608403:0:14300:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863844.609474:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788863844.609483:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788863844.610468:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788863844.610477:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788863844.611391:0:14300:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863844.611757:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788863844.611764:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788863844.612785:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788863844.612795:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788863844.639428:0:14300:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863844.640169:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788863844.640176:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788863844.642317:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788863844.642335:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788863844.644025:0:14300:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788863844.644047:0:14300:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788863844.645341:0:14300:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788863844.645376:0:14300:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788863844.645384:0:14300:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788863844.645802:0:14300:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788863844.646138:0:14300:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788863844.646144:0:14300:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788863844.646146:0:14300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788863844.646147:0:14300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863844.646149:0:14300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863844.646150:0:14300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863844.646152:0:14300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863844.646153:0:14300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788863844.646156:0:14300:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788863844.646158:0:14300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863844.646159:0:14300:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788863844.646162:0:14300:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788863844.646165:0:14300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788863844.646166:0:14300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788863844.646168:0:14300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863844.646169:0:14300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863844.646170:0:14300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863844.646171:0:14300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863844.646172:0:14300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788863844.646174:0:14300:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788863844.646175:0:14300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863844.646176:0:14300:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788863844.646237:0:14300:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788863844.646272:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027008:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788863844.646376:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863844.646438:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4fbba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863844.646528:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324027008 00000100:00100000:2.0:1788863844.646540:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324027008 00000100:00100000:2.0:1788863844.646614:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863844.646628:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee37ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+5:14300:x1875759324027008:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788863844.646702:0:14313:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788863844.646707:0:14313:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788863844.646710:0:14313:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788863844.647273:0:14334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788863844.647712:0:14313:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788863844.649221:0:14335:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788863844.649231:0:14335:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788863844.649234:0:14335:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788863844.649268:0:14335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788863844.649824:0:14313:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788863844.649843:0:14313:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788863844.670441:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee37ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+5:14300:x1875759324027008:12345-0@lo:253:mount.lustre.0 Request processed in 23805us (24052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863844.670461:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863844.670686:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027008:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788863844.670705:0:14300:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788863844.670709:0:14300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788863844.670711:0:14300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788863844.670712:0:14300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863844.670713:0:14300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863844.670714:0:14300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863844.670716:0:14300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863844.670717:0:14300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788863844.670718:0:14300:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788863844.670720:0:14300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863844.670721:0:14300:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788863844.670746:0:14300:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8bfb3af800 from lustre-MDT0000 10000000:01000000:3.0:1788863844.670792:0:14300:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788863844.670796:0:14300:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788863844.670802:0:14300:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e8bc84b99c0 10000000:01000000:3.0:1788863844.670807:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788863844.670818:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8bc84b99c0 from 1 10000000:01000000:3.0:1788863844.670822:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788863844.671362:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863844.671378:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863844.671389:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863844.671411:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788863844.671554:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863844.671645:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4fbbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863844.678377:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324027136 00000100:00100000:2.0:1788863844.678403:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324027136 00000100:00100000:2.0:1788863844.678579:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863844.678595:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee37b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+5:14300:x1875759324027136:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863844.678620:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863844.678654:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bee554c00/0x744cd7666bbbbb3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbb35 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.678694:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bee554c00/0x744cd7666bbbbb3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbb35 expref: 6 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.678709:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bee554c00/0x744cd7666bbbbb3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbb35 expref: 6 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.678720:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554c00, rc 0) 00000100:00100000:2.0:1788863844.678869:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee37b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+6:14300:x1875759324027136:12345-0@lo:101:mount.lustre.0 Request processed in 254us (7370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863844.678878:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863844.680167:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863844.680195:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb3c expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.680208:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbb3c expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863844.680303:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863844.680359:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.684909:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bedcc4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863844.688199:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324027264 00000100:00100000:0.0:1788863844.688232:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324027264 00000100:00100000:0.0:1788863844.688338:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788863844.688352:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee37bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+6:14300:x1875759324027264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863844.688700:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee37bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+6:14300:x1875759324027264:12345-0@lo:501:mount.lustre.0 Request processed in 351us (8338us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788863844.688708:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863844.689351:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027264:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788863844.689408:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788863844.689438:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb3c expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.689453:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb3c expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863844.689464:0:14300:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8bfb3af800 10000000:01000000:1.0:1788863844.689546:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788863844.689553:0:14300:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e8bfb3af800 10000000:01000000:1.0:1788863844.689556:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788863844.689560:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e8bfb3af800 from 1 10000000:01000000:1.0:1788863844.689563:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788863844.689609:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbbb43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.689631:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbbb43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.689644:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbbb43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863844.689671:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863844.689724:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.689759:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bedcc4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863844.690135:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324027392 00000100:00100000:0.0:1788863844.690143:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324027392 00000100:00100000:0.0:1788863844.690203:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863844.690216:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+6:14300:x1875759324027392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863844.690244:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863844.690265:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bff18a000/0x744cd7666bbbbb4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbb43 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863844.690296:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bff18a000/0x744cd7666bbbbb4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbb43 expref: 7 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863844.690312:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bff18a000/0x744cd7666bbbbb4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbb43 expref: 7 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863844.690323:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18a000, rc 0) 00000100:00100000:0.0:1788863844.690381:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+7:14300:x1875759324027392:12345-0@lo:101:mount.lustre.0 Request processed in 168us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863844.690389:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863844.692126:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863844.692163:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbbb43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb4a expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.692176:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbbb43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbb4a expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863844.692201:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788863844.692224:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbbb43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb4a expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.692232:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b800/0x744cd7666bbbbb43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb4a expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863844.692242:0:14300:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788863844.692252:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863844.692260:0:14300:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e8bfb3af800 10000000:01000000:1.0:1788863844.692263:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788863844.692405:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788863844.692408:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788863844.692445:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7be00/0x744cd7666bbbbb51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.692454:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7be00/0x744cd7666bbbbb51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.692464:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7be00/0x744cd7666bbbbb51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863844.692509:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863844.692573:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.692630:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bedcc4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863844.692798:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324027520 00000100:00100000:3.0:1788863844.692809:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324027520 00000100:00100000:3.0:1788863844.692899:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788863844.692908:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+7:14300:x1875759324027520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788863844.692922:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863844.692937:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbbbb58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbb51 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863844.692961:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbbbb58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbb51 expref: 8 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863844.692971:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bffc17400/0x744cd7666bbbbb58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbb51 expref: 8 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863844.692980:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17400, rc 0) 00000100:00100000:3.0:1788863844.693032:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+8:14300:x1875759324027520:12345-0@lo:101:mount.lustre.0 Request processed in 125us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863844.693039:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863844.693419:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863844.693433:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7be00/0x744cd7666bbbbb51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb58 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.693443:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7be00/0x744cd7666bbbbb51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbb58 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863844.693522:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863844.693553:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.693585:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bedcc4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863844.693696:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324027648 00000100:00100000:2.0:1788863844.693702:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324027648 00000100:00100000:2.0:1788863844.693750:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863844.693757:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee37a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+8:14300:x1875759324027648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863844.694253:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee37a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+9:14300:x1875759324027648:12345-0@lo:501:mount.lustre.0 Request processed in 495us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863844.694260:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863844.694662:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863844.694706:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863844.694754:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.694802:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bedcc4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863844.694879:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324027776 00000100:00100000:0.0:1788863844.694887:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324027776 00000100:00100000:0.0:1788863844.694933:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863844.694942:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+9:14300:x1875759324027776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863844.695324:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+9:14300:x1875759324027776:12345-0@lo:503:mount.lustre.0 Request processed in 381us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863844.695331:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863844.695619:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324027776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788863844.696790:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98ce9f4a-6069-439b-828d-fac2605e9de4:14336:1875759324027904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863844.697272:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863844.697327:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4fbb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863844.697398:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324027904 00000100:00100000:0.0:1788863844.697405:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324027904 00000100:00100000:0.0:1788863844.697458:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863844.697480:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+9:14336:x1875759324027904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863844.697926:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+9:14336:x1875759324027904:12345-0@lo:502:llog_process_th.0 Request processed in 457us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863844.697946:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788863844.698497:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98ce9f4a-6069-439b-828d-fac2605e9de4:14336:1875759324027904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788863844.698586:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863844.698601:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863844.698604:0:14336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788863844.698610:0:14336:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788863844.698620:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788863844.698638:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e8bff718000) 00000020:00000080:3.0:1788863844.698661:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788863844.698668:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788863844.698756:0:14336:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788863844.698763:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbbbb66 00000020:00000080:3.0:1788863844.699055:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788863844.699060:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863844.699064:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863844.699066:0:14336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788863844.699068:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788863844.699071:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863844.699072:0:14336:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788863844.699075:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788863844.699083:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e8bff7199c0) 00000020:00000080:3.0:1788863844.699093:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788863844.699097:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788863844.699099:0:14336:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788863844.699102:0:14336:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788863844.699107:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788863844.699161:0:14336:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8bfb3af800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788863844.699177:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e8bff71b380) 00000020:00000080:3.0:1788863844.699187:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788863844.699245:0:14336:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788863844.699251:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x744cd7666bbbbb7b 00000020:00000080:3.0:1788863844.699346:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788863844.699353:0:14336:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788863844.699357:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x744cd7666bbbbb82 00080000:01000000:3.0:1788863844.699363:0:14336:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788863844.699366:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbbbb89 00010000:00010000:2.0:1788863844.805085:0:14336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788863844.805802:0:14336:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788863844.806574:0:14336:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788863844.807465:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e8bd224b380) 00000020:00000080:2.0:1788863844.807494:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788863844.807626:0:14336:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788863844.807636:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbbbb97 00000020:00000080:2.0:1788863844.808612:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788863844.838748:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x744cd7666bbbbb9e 00000020:00000080:1.0:1788863844.840357:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788863844.840375:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863844.840386:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863844.840389:0:14336:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788863844.840393:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788863844.840396:0:14336:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788863844.840398:0:14336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788863844.840399:0:14336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788863844.840401:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788863844.840404:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863844.840405:0:14336:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788863844.840408:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863844.840413:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863844.840415:0:14336:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788863844.840421:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788863844.840482:0:14336:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788863844.840508:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863844.840512:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863844.840514:0:14336:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788863844.840517:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788863844.840520:0:14336:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788863844.840524:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863844.840525:0:14336:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788863844.840528:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788863844.840535:0:14336:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:1.0:1788863844.840569:0:14336:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788863844.840573:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788863844.840589:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e8bff030000) 00000020:00000080:1.0:1788863844.840606:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788863844.840620:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788863844.840678:0:14336:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788863844.840686:0:14336:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788863844.840693:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbbbbac 00010000:00080000:1.0:1788863844.840727:0:14336:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8bee4d0000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788863844.840980:0:14336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788863844.842728:0:14336:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788863844.842794:0:14336:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788863844.845782:0:14336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863844.845986:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788863844.846072:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788863844.847835:0:14340:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788863844.847848:0:14340:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788863844.849793:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788863844.849822:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788863844.850001:0:14336:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788863844.850025:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x744cd7666bbbbbb3 00000100:00080000:3.0:1788863844.850040:0:14336:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788863844.850056:0:14336:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8bee4d0000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788863844.850252:0:14336:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bffcfdc00 x1875759324028032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788863844.850360:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324028032:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788863844.850439:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759324028032 offset 0 length 520: 4 00000100:00080000:3.0:1788863844.850829:0:14336:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788863844.850952:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788863844.850957:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863844.850960:0:14336:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788863844.850963:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788863844.850966:0:14336:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788863844.850968:0:14336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788863844.850970:0:14336:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788863844.850971:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788863844.850974:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863844.850975:0:14336:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788863844.850978:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788863844.850983:0:14336:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788863844.850985:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788863844.850987:0:14336:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788863844.850990:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788863844.850994:0:14336:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:3.0:1788863844.851019:0:14336:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788863844.851022:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788863844.851038:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e8bff71cd40) 00000020:00000080:3.0:1788863844.851056:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788863844.851062:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788863844.851158:0:14336:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788863844.851168:0:14336:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788863844.851188:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x744cd7666bbbbbc1 00010000:00080000:3.0:1788863844.851235:0:14336:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8bff0c5800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1788863844.851795:0:14336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788863844.852140:0:14336:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788863844.852175:0:14336:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788863844.853020:0:14336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788863844.853097:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788863844.853315:0:14336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788863844.854115:0:14342:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788863844.854123:0:14342:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788863844.857098:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788863844.857191:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788863844.857260:0:14336:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788863844.857359:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x744cd7666bbbbbc8 00000100:00080000:0.0:1788863844.857377:0:14336:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788863844.857392:0:14336:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8bff0c5800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788863844.857448:0:14336:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bcabdc380 x1875759324028160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788863844.857562:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324028160:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788863844.857645:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759324028160 offset 0 length 520: 4 00000100:00080000:0.0:1788863844.857721:0:14336:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788863844.857807:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863844.857824:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863844.857827:0:14336:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788863844.857830:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863844.857836:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863844.857837:0:14336:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788863844.857840:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788863844.857843:0:14336:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788863844.857846:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863844.857848:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863844.857875:0:14336:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788863844.857879:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863844.857882:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863844.857883:0:14336:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788863844.857888:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788863844.857927:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98ce9f4a-6069-439b-828d-fac2605e9de4:14336:1875759324028288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863844.858010:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863844.858029:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863844.858453:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324028288 00000100:00100000:3.0:1788863844.858463:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324028288 00000100:00100000:3.0:1788863844.858547:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863844.858561:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+9:14336:x1875759324028288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863844.858972:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+9:14336:x1875759324028288:12345-0@lo:502:llog_process_th.0 Request processed in 413us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863844.858982:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788863844.859260:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98ce9f4a-6069-439b-828d-fac2605e9de4:14336:1875759324028288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788863844.859308:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863844.859316:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863844.859319:0:14336:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788863844.859324:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788863844.860477:0:14300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788863844.860532:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788863844.860562:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7be00/0x744cd7666bbbbb51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb58 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863844.860579:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7be00/0x744cd7666bbbbb51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb58 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863844.860590:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e8bfb3af800 from 1 10000000:01000000:3.0:1788863844.860594:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788863844.860654:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863844.860663:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863844.860698:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863844.860738:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324028416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788863844.860825:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863844.860897:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33c3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788863844.861828:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324028416 00000100:00100000:1.0:1788863844.861843:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324028416 00000100:00100000:1.0:1788863844.862140:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788863844.862153:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+9:14300:x1875759324028416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863844.862178:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863844.862212:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7a000/0x744cd7666bbbbbd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbbcf expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.862252:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7a000/0x744cd7666bbbbbd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbbcf expref: 10 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.862267:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7a000/0x744cd7666bbbbbd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbbcf expref: 10 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.862297:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a000, rc 0) 00000100:00100000:1.0:1788863844.862401:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+10:14300:x1875759324028416:12345-0@lo:101:mount.lustre.0 Request processed in 252us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863844.862409:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788863844.862600:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324028416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863844.862632:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbbd6 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863844.862643:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbbd6 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863844.863258:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324028544:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788863844.863331:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863844.863601:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863844.863678:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324028544 00000100:00100000:3.0:1788863844.863686:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324028544 00000100:00100000:3.0:1788863844.863787:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863844.863798:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+10:14300:x1875759324028544:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788863844.863835:0:14311:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788863844.863845:0:14311:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788863844.863986:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+10:14300:x1875759324028544:12345-0@lo:256:mount.lustre.0 Request processed in 189us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863844.863995:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788863844.864110:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324028544:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788863844.864820:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788863844.864885:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbbd6 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.864901:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbbd6 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863844.864911:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bfb3af800 from 1 10000000:01000000:1.0:1788863844.864915:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788863844.864963:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.864972:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.864983:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863844.865010:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324028672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863844.865058:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.865104:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863844.865135:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324028672 00000100:00100000:2.0:1788863844.865145:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324028672 00000100:00100000:2.0:1788863844.865199:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788863844.865210:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+10:14300:x1875759324028672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863844.865225:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863844.865245:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbbe4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbbdd expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.865281:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbbe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbbdd expref: 11 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.865315:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbbe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbbdd expref: 11 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.865329:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554800, rc 0) 00000100:00100000:2.0:1788863844.865384:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14300:x1875759324028672:12345-0@lo:101:mount.lustre.0 Request processed in 175us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863844.865391:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863844.865423:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324028672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863844.865446:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbbe4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.865456:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbbe4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863844.865557:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324028800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863844.865583:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.865605:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788863844.865622:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324028800 00000100:00100000:3.0:1788863844.865627:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324028800 00000100:00100000:3.0:1788863844.865656:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788863844.865665:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14300:x1875759324028800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863844.866196:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14300:x1875759324028800:12345-0@lo:501:mount.lustre.0 Request processed in 531us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863844.866205:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788863844.866224:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324028800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863844.866296:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324028928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863844.866337:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.866366:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788863844.866721:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324028928 00000100:00100000:2.0:1788863844.866728:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324028928 00000100:00100000:2.0:1788863844.866766:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863844.866774:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14300:x1875759324028928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788863844.868316:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14300:x1875759324028928:12345-0@lo:503:mount.lustre.0 Request processed in 1528us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863844.868333:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788863844.868701:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324028928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863844.870186:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98ce9f4a-6069-439b-828d-fac2605e9de4:14344:1875759324029056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863844.870310:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.870403:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863844.870604:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324029056 00000100:00100000:3.0:1788863844.870626:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324029056 00000100:00100000:3.0:1788863844.870745:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788863844.870758:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14344:x1875759324029056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788863844.871148:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14344:x1875759324029056:12345-0@lo:502:llog_process_th.0 Request processed in 391us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863844.871157:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788863844.871366:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98ce9f4a-6069-439b-828d-fac2605e9de4:14344:1875759324029056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788863844.871405:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863844.871431:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863844.871434:0:14344:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788863844.871443:0:14344:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8bfb3af800 00000020:00000080:1.0:1788863844.871445:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788863844.871455:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863844.871458:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863844.871460:0:14344:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788863844.871479:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863844.871482:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863844.871484:0:14344:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788863844.871488:0:14344:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8bfb3af800 00000020:00000080:1.0:1788863844.871490:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788863844.871571:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863844.871574:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863844.871576:0:14344:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788863844.871579:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863844.871582:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863844.871583:0:14344:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788863844.871586:0:14344:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8bfb3af800 00000020:00000080:1.0:1788863844.871588:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788863844.871638:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98ce9f4a-6069-439b-828d-fac2605e9de4:14344:1875759324029184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863844.871680:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863844.872418:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324029184 00000100:00100000:0.0:1788863844.872427:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324029184 00000100:00100000:0.0:1788863844.872469:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863844.872479:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14344:x1875759324029184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863844.872715:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14344:x1875759324029184:12345-0@lo:502:llog_process_th.0 Request processed in 237us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863844.872723:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788863844.872902:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788863844.872924:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98ce9f4a-6069-439b-828d-fac2605e9de4:14344:1875759324029184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788863844.872958:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863844.872967:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863844.872970:0:14344:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788863844.872976:0:14344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788863844.876094:0:14300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788863844.876148:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863844.876187:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbbe4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863844.876211:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbbe4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863844.876296:0:14300:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788863844.876300:0:14300:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8bfb3af800 10000000:01000000:0.0:1788863844.876304:0:14300:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8bfb3af800 10000000:01000000:0.0:1788863844.876310:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788863844.876325:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e8bfb3af800 from 1 10000000:01000000:0.0:1788863844.876329:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788863844.876390:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bff18a600/0x744cd7666bbbbbeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863844.876399:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bff18a600/0x744cd7666bbbbbeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863844.876414:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bff18a600/0x744cd7666bbbbbeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863844.876449:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324029312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788863844.877216:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863844.877293:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788863844.880252:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324029312 00000100:00100000:3.0:1788863844.880292:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324029312 00000100:00100000:3.0:1788863844.880382:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788863844.880396:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14300:x1875759324029312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788863844.880421:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863844.880449:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bffc16400/0x744cd7666bbbbbf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbbeb expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863844.880495:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc16400/0x744cd7666bbbbbf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbbeb expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863844.880519:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bffc16400/0x744cd7666bbbbbf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbbeb expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863844.880532:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16400, rc 0) 00000100:00100000:3.0:1788863844.880653:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14300:x1875759324029312:12345-0@lo:101:mount.lustre.0 Request processed in 258us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863844.880662:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788863844.883157:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324029312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863844.883206:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bff18a600/0x744cd7666bbbbbeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbbf2 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863844.883224:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bff18a600/0x744cd7666bbbbbeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbbf2 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863844.883341:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324029440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863844.883417:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863844.883490:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788863844.883577:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324029440 00000100:00100000:2.0:1788863844.883586:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324029440 00000100:00100000:2.0:1788863844.884420:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788863844.884433:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14300:x1875759324029440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863844.884926:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14300:x1875759324029440:12345-0@lo:501:mount.lustre.0 Request processed in 493us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863844.884935:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863844.887023:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324029440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863844.887116:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324029568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863844.887223:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863844.887289:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788863844.887444:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324029568 00000100:00100000:1.0:1788863844.887454:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324029568 00000100:00100000:1.0:1788863844.887675:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788863844.887688:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14300:x1875759324029568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863844.889831:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14300:x1875759324029568:12345-0@lo:503:mount.lustre.0 Request processed in 2129us (2593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863844.889868:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788863844.891664:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324029568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863844.893058:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98ce9f4a-6069-439b-828d-fac2605e9de4:14350:1875759324029696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863844.893189:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.893250:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324029696 00000100:00100000:1.0:1788863844.893259:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324029696 00000100:00100000:1.0:1788863844.893327:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788863844.893337:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14350:x1875759324029696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863844.893694:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14350:x1875759324029696:12345-0@lo:502:llog_process_th.0 Request processed in 357us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863844.893704:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788863844.893772:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8be6596840 going to sleep for 11 seconds 00000100:00100000:1.0:1788863844.893797:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98ce9f4a-6069-439b-828d-fac2605e9de4:14350:1875759324029696:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788863844.893911:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788863844.893935:0:14350:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e8bff034d40) 00000020:00000080:1.0:1788863844.893968:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788863844.894066:0:14350:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8bfb3af800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788863844.894072:0:14350:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8bfb3af800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788863844.894076:0:14350:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8bfb3af800 4 00010000:00080000:1.0:1788863844.894132:0:14350:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8becca6000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788863844.898480:0:14350:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788863844.898781:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788863844.898926:0:14350:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788863844.898945:0:14350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x744cd7666bbbbc00 00000100:00080000:1.0:1788863844.898960:0:14350:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788863844.898974:0:14350:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e8becca6000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788863844.899023:0:14350:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bc8515500 x1875759324029824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863844.899048:0:14350:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788863844.899077:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863844.899147:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863844.899150:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863844.899153:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788863844.901676:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98ce9f4a-6069-439b-828d-fac2605e9de4:14350:1875759324029952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788863844.901822:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.902625:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324029952 00000100:00100000:1.0:1788863844.902637:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324029952 00000100:00100000:1.0:1788863844.902708:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863844.902719:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14350:x1875759324029952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788863844.902929:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4e8f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788863844.904122:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875759324029824:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788863844.904197:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.904347:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14350:x1875759324029952:12345-0@lo:502:llog_process_th.0 Request processed in 1626us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863844.904361:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788863844.906060:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324029824 00000100:00100000:3.0:1788863844.906083:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324029824 00000100:00100000:3.0:1788863844.906153:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863844.906163:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875759324029824:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788863844.906363:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875759324029824:12345-0@lo:38:llog_process_th.0 Request processed in 198us (2164us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788863844.906374:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863844.906453:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788863844.906466:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8becca6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788863844.906471:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788863844.906478:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875759324029824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788863844.908432:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98ce9f4a-6069-439b-828d-fac2605e9de4:14350:1875759324029952:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788863844.908523:0:14350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788863844.908830:0:14300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788863844.908904:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788863844.908937:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bff18a600/0x744cd7666bbbbbeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbbf2 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.908951:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bff18a600/0x744cd7666bbbbbeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbbf2 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788863844.909030:0:14300:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788863844.909033:0:14300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788863844.909034:0:14300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863844.909035:0:14300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863844.909036:0:14300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863844.909038:0:14300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863844.909040:0:14300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788863844.909042:0:14300:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788863844.909051:0:14300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863844.909052:0:14300:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788863844.909058:0:14300:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788863844.909061:0:14300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788863844.909062:0:14300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788863844.909063:0:14300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863844.909064:0:14300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863844.909065:0:14300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863844.909067:0:14300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863844.909067:0:14300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788863844.909068:0:14300:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788863844.909069:0:14300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863844.909070:0:14300:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788863844.909118:0:14300:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788863844.909144:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324030080:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788863844.909255:0:14300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.909309:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe3bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863844.909438:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324030080 00000100:00100000:0.0:1788863844.909451:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324030080 00000100:00100000:0.0:1788863844.910713:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863844.910739:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14300:x1875759324030080:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788863844.910791:0:14312:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788863844.910813:0:14312:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788863844.983952:0:14312:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788863844.983975:0:14312:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788863844.984004:0:14334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788863844.984010:0:14334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788863844.984040:0:14334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863844.984068:0:14334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bf4e7a000/0x744cd7666bbbbbd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbbcf expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863844.984078:0:14334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863844.985198:0:14334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bf4e7a000/0x744cd7666bbbbbd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbbbcf expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863844.985226:0:14334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bf4e7a000/0x744cd7666bbbbbd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbbbcf expref: 12 pid: 14313 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863844.985246:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabded80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14334:1875759324030208:0@lo:104: 00000100:00100000:0.0:1788863844.985369:0:14334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.985445:0:14301:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324030208 00000100:00100000:1.0:1788863844.985463:0:14301:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324030208 00000100:00100000:1.0:1788863844.985556:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863844.985568:0:14301:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:98ce9f4a-6069-439b-828d-fac2605e9de4+3:14334:x1875759324030208:12345-0@lo:104: 00010000:00010000:1.0:1788863844.985584:0:14301:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbbd6 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.985657:0:14301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863844.985664:0:14301:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:98ce9f4a-6069-439b-828d-fac2605e9de4+3:14334:x1875759324030208:12345-0@lo:104: Request processed in 99us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863844.985672:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788863844.985700:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863844.985707:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbbd6 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.985716:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17e00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:1.0:1788863844.985730:0:14307:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbbbd6 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.985742:0:14307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbbbd6 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863844.985751:0:14307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbbbd6 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863844.985758:0:14307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788863844.985811:0:14307:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbbd6 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.985819:0:14307:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863844.985878:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbbd6 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.985887:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17e00/0x744cd7666bbbbbcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbbd6 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.985913:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863844.985914:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324030336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863844.985915:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863844.985916:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863844.985953:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863844.985955:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc4fbba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863844.985982:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabded80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14334:1875759324030208:0@lo:104: 00010000:00010000:1.0:1788863844.986008:0:14334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863844.986256:0:14303:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324030336 00000100:00100000:2.0:1788863844.986261:0:14303:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324030336 00010000:00010000:2.0:1788863844.986287:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bf4e7a000/0x744cd7666bbbbbd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbbcf expref: 13 pid: 14313 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863844.986321:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863844.986327:0:14303:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98ce9f4a-6069-439b-828d-fac2605e9de4+13:3307:x1875759324030336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863844.986348:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863844.986354:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bf4e7a000/0x744cd7666bbbbbd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbbcf expref: 13 pid: 14313 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.986365:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bf4e7a000/0x744cd7666bbbbbd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbbbcf expref: 13 pid: 14313 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.986380:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7a000/0x744cd7666bbbbbd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbbbcf expref: 13 pid: 14313 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.986395:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.986403:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788863844.986420:0:14303:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002411241s 00010000:00010000:2.0:1788863844.986425:0:14303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.986432:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.986439:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.986445:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.986451:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863844.986456:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.986687:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.986842:0:14334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863844.986899:0:14334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.987066:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.987077:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bff18a800/0x744cd7666bbbbc07 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863844.987095:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863844.987169:0:14303:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98ce9f4a-6069-439b-828d-fac2605e9de4+12:3307:x1875759324030336:12345-0@lo:103:ldlm_bl.0 Request processed in 840us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863844.987177:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788863844.987320:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324030336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863844.996744:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14300:x1875759324030080:12345-0@lo:253:mount.lustre.0 Request processed in 85991us (87464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863844.996771:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788863844.996775:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:14300:1875759324030080:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788863844.996799:0:14300:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788863844.996803:0:14300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788863844.996805:0:14300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788863844.996806:0:14300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863844.996808:0:14300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863844.996809:0:14300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863844.996810:0:14300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863844.996811:0:14300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788863844.996813:0:14300:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788863844.996815:0:14300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863844.996817:0:14300:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788863844.996843:0:14300:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788863845.001801:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788863845.002093:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788863845.002469:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788863845.002660:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788863845.003183:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788863845.003435:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788863845.004682:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788863845.005084:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788863845.005452:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788863845.005659:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788863845.006105:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788863845.006349:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788863845.045551:0:14300:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788863845.046408:0:14300:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788863845.046636:0:14357:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788863845.046641:0:14357:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788863845.047308:0:14358:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788863845.047442:0:14358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788863845.051008:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788863845.051151:0:14358:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788863845.051159:0:14358:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788863845.053075:0:14300:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788863845.053234:0:14300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788863845.054445:0:14300:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788863845.054467:0:14300:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788863845.054748:0:14300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863845.056542:0:14300:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788863845.057743:0:14300:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788863845.058322:0:14300:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788863845.061621:0:14300:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788863845.069588:0:14300:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788863845.121283:0:14300:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788863845.121355:0:14300:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffacc5c168f988 00100000:10000000:0.0:1788863845.121369:0:14300:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788863845.122920:0:14300:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788863845.122947:0:14300:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788863845.122968:0:14300:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788863845.122999:0:14300:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788863845.526283:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863845.910728:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788863846.424196:0:14316:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788863846.424205:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e8bfb3af800 from 6 10000000:01000000:1.0:1788863846.424220:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788863846.424293:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.424307:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.424321:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863846.424460:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324030464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788863846.424562:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863846.424640:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324030464 00000100:00100000:1.0:1788863846.424642:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe240c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863846.424654:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324030464 00000100:00100000:0.0:1788863846.424729:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788863846.424740:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14316:x1875759324030464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863846.424771:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863846.424786:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bff18aa00/0x744cd7666bbbbc15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbc0e expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863846.424808:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bff18aa00/0x744cd7666bbbbc15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbc0e expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863846.424820:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bff18aa00/0x744cd7666bbbbc15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbc0e expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863846.424829:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18aa00, rc 0) 00000100:00100000:0.0:1788863846.424908:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14316:x1875759324030464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863846.424916:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788863846.425027:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324030464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863846.425049:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc15 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863846.425060:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbc15 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863846.425130:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca961f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324030592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788863846.425166:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863846.425193:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd2849480 going to sleep for 11 seconds 00000100:00100000:0.0:1788863846.425281:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324030592 00000100:00100000:0.0:1788863846.425285:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324030592 00000100:00100000:0.0:1788863846.425311:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788863846.425322:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14316:x1875759324030592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788863846.425336:0:14312:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788863846.425357:0:14312:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788863846.425362:0:14312:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788863846.425981:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14316:x1875759324030592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 659us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863846.425991:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788863846.426030:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca961f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324030592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788863846.426076:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788863846.426085:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc15 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863846.426100:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc15 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863846.550020:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863846.934502:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788863847.578677:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863848.606433:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863849.622114:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863850.074788:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98ce9f4a-6069-439b-828d-fac2605e9de4:3308:1875759324030720:0@lo:400:kworker.0 00000100:00100000:1.0:1788863850.074905:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788863850.075005:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788863850.075010:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788863850.075013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788863850.075016:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788863850.075019:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788863850.075021:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788863850.075025:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e8becca6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788863850.075042:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e8becca6000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788863850.075092:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bffcfc000 x1875759324030848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863850.075904:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875759324030848:0@lo:38:kworker.0 00000100:00100000:0.0:1788863850.075962:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863850.076032:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324030720 00000100:00100000:0.0:1788863850.076042:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324030720 00000100:00100000:0.0:1788863850.076101:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788863850.076111:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+12:3308:x1875759324030720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863850.078702:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324030848 00000100:00100000:3.0:1788863850.078716:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324030848 00000100:00100000:3.0:1788863850.078755:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863850.078763:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875759324030848:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788863850.078791:0:14320:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:3.0:1788863850.078824:0:14320:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x744cd7666bbbbc1c 00000004:00100000:3.0:1788863850.078841:0:14320:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788863850.079024:0:14320:0:(import.c:65:import_set_state_nolock()) ffff8e8bfb3ae000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863850.079113:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875759324030848:12345-0@lo:38:kworker.0 Request processed in 349us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863850.079120:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788863850.079169:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8bffcfc000 x1875759324030848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788863850.079185:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788863850.079192:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788863850.079196:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788863850.079198:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8becca6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788863850.079204:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875759324030848:0@lo:38:kworker.0 00000100:00100000:0.0:1788863850.085645:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+12:3308:x1875759324030720:12345-0@lo:400:kworker.0 Request processed in 9517us (10722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863850.085664:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788863850.086137:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98ce9f4a-6069-439b-828d-fac2605e9de4:3308:1875759324030720:0@lo:400:kworker.0 00000001:02000400:3.0:1788863850.610236:0:14601:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788863850.646055:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863851.672534:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863852.695655:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863853.718155:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863854.166008:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863844/real 1788863844] req@ffff8e8bcabdc380 x1875759324028160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863854 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863854.166050:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8bcabdc380 x1875759324028160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863854 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863854.166105:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863844/real 1788863844] req@ffff8e8bffcfdc00 x1875759324028032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863854 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863854.166118:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8bffcfdc00 x1875759324028032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863854 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788863854.166160:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff0c5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863854.166191:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788863854.166196:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324028160:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788863854.166202:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bee4d0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863854.166207:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788863854.166210:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324028032:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788863854.166441:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863854.166447:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788863854.166449:0:38:0:(import.c:65:import_set_state_nolock()) ffff8e8bee4d0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863854.166455:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:1.0:1788863854.166460:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788863854.166470:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8bee4d0000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788863854.166492:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bc8514700 x1875759324031104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863854.166512:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863854.166516:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788863854.166523:0:38:0:(import.c:65:import_set_state_nolock()) ffff8e8bff0c5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863854.166527:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:1.0:1788863854.166529:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788863854.166534:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8bff0c5800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788863854.166547:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bc8516d80 x1875759324031232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863854.166593:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759324031360:0@lo:400:kworker.0 00000100:00100000:1.0:1788863854.166658:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863854.166750:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324031360 00000100:00100000:1.0:1788863854.166758:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324031360 00000100:00100000:1.0:1788863854.167075:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863854.167087:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759324031360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863854.167103:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863854.167133:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98ce9f4a-6069-439b-828d-fac2605e9de4:3308:1875759324030976:0@lo:400:kworker.0 00000100:00100000:1.0:1788863854.167150:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759324031360:12345-0@lo:400:kworker.0 Request processed in 63us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863854.167169:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788863854.167222:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8bc8515500 x1875759324031360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863854.167239:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863854.167241:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759324031360:0@lo:400:kworker.0 00000100:00100000:2.0:1788863854.168036:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324031104:0@lo:8:kworker.0 00000400:00000100:2.0:1788863854.168084:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759324031104 offset 0 length 520: 4 00000100:00100000:2.0:1788863854.168106:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324031232:0@lo:8:kworker.0 00000400:00000100:2.0:1788863854.168124:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759324031232 offset 0 length 520: 4 00000100:00100000:1.0:1788863854.168446:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324030976 00000100:00100000:1.0:1788863854.168457:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324030976 00000100:00100000:1.0:1788863854.168536:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788863854.168546:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+12:3308:x1875759324030976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863854.168640:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+12:3308:x1875759324030976:12345-0@lo:400:kworker.0 Request processed in 95us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863854.168649:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788863854.168708:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98ce9f4a-6069-439b-828d-fac2605e9de4:3308:1875759324030976:0@lo:400:kworker.0 00000020:00000080:1.0:1788863854.726148:0:14752:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeacb872e0 20000000:00000080:1.0:1788863854.726170:0:14752:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8befb16400 uarg=0000000000000000 20000000:01000000:1.0:1788863854.726218:0:14752:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788863854.726227:0:14752:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788863854.726233:0:14752:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788863854.727437:0:14753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788863854.732046:0:14752:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788863854.742920:0:14752:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788863854.743205:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863854.743295:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.743330:0:14752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbbe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbbdd expref: 11 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.743338:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.743392:0:14752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbbe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbbbdd expref: 11 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.743409:0:14752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbbe4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbbbdd expref: 11 pid: 14313 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863854.743425:0:14752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14752:1875759324031488:0@lo:104: 00000100:00100000:0.0:1788863854.743500:0:14752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.743577:0:14752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc8a30840 going to sleep for 11 seconds 00000100:00100000:1.0:1788863854.745874:0:14302:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324031488 00000100:00100000:1.0:1788863854.745889:0:14302:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324031488 00000100:00100000:1.0:1788863854.745938:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863854.745948:0:14302:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+3:14752:x1875759324031488:12345-0@lo:104: 00010000:00010000:1.0:1788863854.745965:0:14302:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbbe4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.746065:0:14302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788863854.746072:0:14302:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+3:14752:x1875759324031488:12345-0@lo:104: Request processed in 126us (2572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863854.746079:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863854.746110:0:14752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14752:1875759324031488:0@lo:104: 00010000:00010000:3.0:1788863854.746157:0:14752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.746213:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863854.746221:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbbe4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.746228:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7bc00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:2.0:1788863854.746232:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbbbe4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.746240:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbbbe4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863854.746247:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbbbe4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863854.746253:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788863854.746297:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbbe4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.746314:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863854.746348:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbbe4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863854.746376:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7bc00/0x744cd7666bbbbbdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbbe4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863854.746384:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788863854.746395:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863854.746397:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863854.746398:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98ce9f4a-6069-439b-828d-fac2605e9de4:3306:1875759324031616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863854.746398:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863854.746445:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863854.746666:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324031616 00000100:00100000:0.0:1788863854.746673:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324031616 00010000:00010000:0.0:1788863854.746695:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbbe4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbbdd expref: 12 pid: 14313 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863854.746765:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863854.746773:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+12:3306:x1875759324031616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788863854.746786:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863854.746792:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbbe4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbbdd expref: 12 pid: 14313 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.746803:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbbe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbbbdd expref: 12 pid: 14313 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.746819:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbbe4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbbbdd expref: 12 pid: 14313 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.746843:0:14304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.746879:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.746897:0:14304:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.746905:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.746912:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.746919:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.746935:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863854.746939:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.746947:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.746968:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863854.746979:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863854.747016:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+11:3306:x1875759324031616:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863854.747022:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788863854.747075:0:14752:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.747085:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863854.747093:0:14752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bff18b200/0x744cd7666bbbbc23 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863854.747191:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98ce9f4a-6069-439b-828d-fac2605e9de4:3306:1875759324031616:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788863855.766841:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788863856.086454:0:14316:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863856.086463:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bfb3af800 from 10 10000000:01000000:0.0:1788863856.086469:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863856.086521:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863856.086533:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863856.086545:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863856.086573:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324031744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863856.086660:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863856.086720:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe240c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863856.086782:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324031744 00000100:00100000:2.0:1788863856.086793:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324031744 00000100:00100000:2.0:1788863856.086888:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788863856.086898:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+11:14316:x1875759324031744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863856.086917:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863856.086933:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbbc31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbc2a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863856.086959:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbbc31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbc2a expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863856.086971:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbbc31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbc2a expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863856.086980:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554000, rc 0) 00000100:00100000:2.0:1788863856.087028:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14316:x1875759324031744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863856.087034:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788863856.087137:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324031744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863856.087154:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc31 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863856.087173:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbc31 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863856.087252:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324031872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788863856.087291:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863856.087321:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbbd36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863856.087427:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324031872 00000100:00100000:0.0:1788863856.087432:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324031872 00000100:00100000:0.0:1788863856.087465:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788863856.087473:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14316:x1875759324031872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863856.087731:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14316:x1875759324031872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863856.087739:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788863856.087774:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324031872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863856.087808:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324032000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863856.087847:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863856.087888:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffe24d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863856.087901:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324032000 00000100:00100000:0.0:1788863856.087904:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324032000 00000100:00100000:0.0:1788863856.087921:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788863856.087926:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14316:x1875759324032000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863856.088088:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+12:14316:x1875759324032000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863856.088095:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788863856.088130:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324032000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788863856.089574:0:14791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788863856.089821:0:14316:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788863856.089876:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863856.089888:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc31 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863856.089919:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc31 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788863856.159608:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788863856.790904:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863857.823520:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863858.845603:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788863859.286005:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863859.286012:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863859.286015:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863859.286018:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788863859.286206:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324032256:0@lo:400:kworker.0 00000100:00100000:0.0:1788863859.286283:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863859.286348:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863859.286354:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98ce9f4a-6069-439b-828d-fac2605e9de4:3309:1875759324032128:0@lo:400:kworker.0 00000100:00100000:0.0:1788863859.286396:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863859.286444:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324032128 00000100:00100000:0.0:1788863859.286452:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324032128 00000100:00100000:0.0:1788863859.286500:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788863859.286509:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+12:3309:x1875759324032128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863859.286571:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+12:3309:x1875759324032128:12345-0@lo:400:kworker.0 Request processed in 50us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863859.286579:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788863859.286637:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98ce9f4a-6069-439b-828d-fac2605e9de4:3309:1875759324032128:0@lo:400:kworker.0 00000100:00100000:1.0:1788863859.287026:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324032256 00000100:00100000:1.0:1788863859.287032:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324032256 00000100:00100000:1.0:1788863859.287066:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863859.287074:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324032256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863859.287124:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324032256:12345-0@lo:400:kworker.0 Request processed in 51us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863859.287130:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788863859.287172:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8bc8517100 x1875759324032256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863859.287185:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324032256:0@lo:400:kworker.0 00010000:00010000:3.0:1788863859.862113:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863860.887023:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788863861.526507:0:15002:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788863861.526513:0:15002:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788863861.526679:0:15002:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e8becca5000 00000020:01000004:0.0:1788863861.526701:0:15002:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788863861.526716:0:15002:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788863861.526734:0:15002:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e8bc84b8000) 00000020:00000080:0.0:1788863861.526757:0:15002:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788863861.542350:0:15002:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788863861.542700:0:15002:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788863861.543573:0:15002:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788863861.545918:0:15002:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788863861.546290:0:15002:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788863861.546732:0:15002:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 335: rc = 0 00100000:10000000:0.0:1788863861.546831:0:15002:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 335: rc = 0 00100000:10000000:0.0:1788863861.546981:0:15002:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 335: rc = 0 00100000:10000000:0.0:1788863861.547467:0:15002:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:0.0:1788863861.547747:0:15002:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:0.0:1788863861.548259:0:15002:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 640: rc = 0 00100000:10000000:3.0:1788863861.549848:0:15002:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:3.0:1788863861.550559:0:15002:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 640: rc = 0 00100000:10000000:3.0:1788863861.550973:0:15002:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 640: rc = 0 00000020:00000080:3.0:1788863861.551682:0:15002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788863861.551696:0:15002:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788863861.551710:0:15002:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x744cd7666bbbbc3f 00000020:01000004:3.0:1788863861.551720:0:15002:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788863861.551747:0:15002:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788863861.551765:0:15002:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788863861.551773:0:15002:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788863861.551779:0:15002:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788863861.551792:0:15002:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e8bee48b380) 00000020:00000080:3.0:1788863861.551805:0:15002:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788863861.553307:0:15002:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788863861.553572:0:15002:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788863861.553580:0:15002:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788863861.555069:0:15002:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788863861.555078:0:15002:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788863861.555683:0:15002:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788863861.555691:0:15002:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788863861.557634:0:15002:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863861.558125:0:15002:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788863861.558133:0:15002:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788863861.560152:0:15002:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788863861.560179:0:15002:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788863861.573013:0:15002:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863861.573477:0:15002:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788863861.573487:0:15002:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788863861.574960:0:15002:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788863861.574973:0:15002:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788863861.576245:0:15002:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788863861.576259:0:15002:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788863861.578501:0:15002:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863861.578977:0:15002:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788863861.578986:0:15002:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788863861.580254:0:15002:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788863861.580270:0:15002:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788863861.612451:0:15002:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788863861.612794:0:15002:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788863861.612803:0:15002:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788863861.617041:0:15002:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788863861.617062:0:15002:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788863861.617612:0:15002:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788863861.617645:0:15002:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788863861.617653:0:15002:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788863861.628346:0:15002:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788863861.628426:0:15002:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788863861.628432:0:15002:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788863861.628435:0:15002:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788863861.628437:0:15002:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863861.628438:0:15002:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863861.628439:0:15002:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863861.628441:0:15002:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863861.628443:0:15002:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863861.628445:0:15002:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863861.628446:0:15002:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788863861.628450:0:15002:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788863861.628453:0:15002:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788863861.628454:0:15002:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788863861.628455:0:15002:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863861.628456:0:15002:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863861.628458:0:15002:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863861.628459:0:15002:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863861.628460:0:15002:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863861.628461:0:15002:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863861.628462:0:15002:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788863861.628500:0:15002:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788863861.628534:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324032384:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788863861.628624:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863861.628759:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc12eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863861.629772:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324032384 00000100:00100000:1.0:1788863861.629785:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324032384 00000100:00100000:0.0:1788863861.630061:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788863861.630071:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+12:15002:x1875759324032384:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788863861.630133:0:14311:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788863861.630136:0:14311:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788863861.630140:0:14311:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788863861.636013:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+12:15002:x1875759324032384:12345-0@lo:253:mount.lustre.0 Request processed in 5934us (7380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863861.636029:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788863861.636214:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324032384:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788863861.636236:0:15002:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788863861.636240:0:15002:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788863861.636257:0:15002:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788863861.636259:0:15002:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788863861.636260:0:15002:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788863861.636261:0:15002:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788863861.636263:0:15002:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788863861.636264:0:15002:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788863861.636267:0:15002:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788863861.636268:0:15002:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788863861.636293:0:15002:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8becca5000 from lustre-OST0000 10000000:01000000:0.0:1788863861.636324:0:15002:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788863861.636328:0:15002:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788863861.636337:0:15002:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e8bc84b99c0 local copy 00010000:00010000:0.0:1788863861.636351:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb3c expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863861.636703:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324032512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863861.637197:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863861.637295:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863861.637354:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324032512 00000100:00100000:2.0:1788863861.637364:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324032512 00000100:00100000:2.0:1788863861.637459:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788863861.637470:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+12:15002:x1875759324032512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863861.637845:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+12:15002:x1875759324032512:12345-0@lo:501:mount.lustre.0 Request processed in 375us (647us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863861.637883:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788863861.638129:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324032512:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788863861.638155:0:15002:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788863861.638345:0:15002:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788863861.638356:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb3c expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.638369:0:15002:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb3c expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863861.638401:0:15002:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8becca5000 10000000:01000000:1.0:1788863861.638407:0:15002:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788863861.638414:0:15002:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e8bc84b99c0 10000000:01000000:1.0:1788863861.638418:0:15002:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788863861.638421:0:15002:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e8bc84b99c0 from 1 10000000:01000000:1.0:1788863861.638424:0:15002:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788863861.638459:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a200/0x744cd7666bbbbc4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.638467:0:15002:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a200/0x744cd7666bbbbc4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.638476:0:15002:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a200/0x744cd7666bbbbc4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863861.638500:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324032640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863861.638611:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863861.638699:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd01c5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863861.638770:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324032640 00000100:00100000:2.0:1788863861.638778:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324032640 00000100:00100000:3.0:1788863861.638915:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788863861.638923:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+12:15002:x1875759324032640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788863861.638933:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863861.638948:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbbc54 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbc4d expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863861.638987:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbbc54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbc4d expref: 13 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863861.638999:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bffc17a00/0x744cd7666bbbbc54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbc4d expref: 13 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863861.639008:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17a00, rc 0) 00000100:00100000:3.0:1788863861.639051:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+13:15002:x1875759324032640:12345-0@lo:101:mount.lustre.0 Request processed in 129us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863861.639057:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788863861.639138:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324032640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863861.639152:0:15002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a200/0x744cd7666bbbbc4d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc54 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.639161:0:15002:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a200/0x744cd7666bbbbc4d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbc54 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863861.639199:0:15002:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788863861.639221:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a200/0x744cd7666bbbbc4d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc54 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.639230:0:15002:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a200/0x744cd7666bbbbc4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc54 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863861.639237:0:15002:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788863861.639242:0:15002:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788863861.639247:0:15002:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788863861.639249:0:15002:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788863861.639269:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b400/0x744cd7666bbbbc5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.639277:0:15002:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b400/0x744cd7666bbbbc5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.639284:0:15002:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b400/0x744cd7666bbbbc5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863861.639298:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324032768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863861.639327:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863861.639353:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd01c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788863861.639408:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324032768 00000100:00100000:3.0:1788863861.639412:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324032768 00000100:00100000:3.0:1788863861.639429:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788863861.639435:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+13:15002:x1875759324032768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788863861.639443:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863861.639451:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbbc62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbc5b expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863861.639464:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbbc62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbc5b expref: 14 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863861.639471:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bffc17200/0x744cd7666bbbbc62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbc5b expref: 14 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863861.639477:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17200, rc 0) 00000100:00100000:1.0:1788863861.639610:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324032768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863861.639621:0:15002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b400/0x744cd7666bbbbc5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc62 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.639629:0:15002:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b400/0x744cd7666bbbbc5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbc62 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863861.640370:0:15002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000100:00100000:3.0:1788863861.640630:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+14:15002:x1875759324032768:12345-0@lo:101:mount.lustre.0 Request processed in 76us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863861.640640:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000040:00080000:0.0:1788863861.642707:0:15002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863861.643217:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788863861.643268:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788863861.643305:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788863861.643356:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788863861.643409:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788863861.643442:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788863861.643510:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788863861.643599:0:15002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788863861.643746:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324032896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863861.643848:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863861.644067:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788863861.644116:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324032896 00000100:00100000:3.0:1788863861.644128:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324032896 00000100:00100000:3.0:1788863861.644253:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788863861.644266:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+14:15002:x1875759324032896:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863861.644780:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+14:15002:x1875759324032896:12345-0@lo:501:mount.lustre.0 Request processed in 515us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863861.644789:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788863861.645055:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324032896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863861.645119:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033024:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863861.645190:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863861.645227:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788863861.645281:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324033024 00000100:00100000:2.0:1788863861.645289:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324033024 00000100:00100000:2.0:1788863861.645325:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788863861.645334:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+14:15002:x1875759324033024:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788863861.646196:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+14:15002:x1875759324033024:12345-0@lo:503:mount.lustre.0 Request processed in 856us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863861.646206:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788863861.646435:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033024:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788863861.647793:0:15002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788863861.647979:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863861.648065:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863861.648175:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff1a5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788863861.648236:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324033152 00000100:00100000:2.0:1788863861.648245:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324033152 00000100:00100000:2.0:1788863861.648330:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788863861.648339:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+14:15002:x1875759324033152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863861.648640:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+14:15002:x1875759324033152:12345-0@lo:502:mount.lustre.0 Request processed in 301us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863861.648649:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788863861.648728:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863861.649040:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788863861.649091:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788863861.649117:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788863861.649155:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788863861.649198:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788863861.649239:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788863861.649281:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788863861.649317:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788863861.649347:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788863861.649391:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788863861.649424:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788863861.649470:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788863861.649514:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863861.649562:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863861.650575:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd01c5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788863861.650691:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324033280 00000100:00100000:0.0:1788863861.650705:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324033280 00000100:00100000:0.0:1788863861.650757:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788863861.650766:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+14:15002:x1875759324033280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863861.651051:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+14:15002:x1875759324033280:12345-0@lo:502:mount.lustre.0 Request processed in 284us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863861.651059:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788863861.651192:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863861.651295:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788863861.651309:0:15002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788863861.652827:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788863861.652838:0:15016:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788863861.652846:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863861.652876:0:15016:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788863861.652884:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788863861.652912:0:15016:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e8bf5bb99c0) 00000020:00000080:0.0:1788863861.652936:0:15016:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788863861.652945:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788863861.653024:0:15016:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8becca5000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788863861.653032:0:15016:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788863861.653038:0:15016:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x744cd7666bbbbc70 00010000:00010000:0.0:1788863861.657244:0:15016:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788863861.657705:0:15016:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788863861.659450:0:15016:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788863861.661260:0:15016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788863861.661275:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863861.661282:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863861.661285:0:15016:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788863861.661290:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788863861.661294:0:15016:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788863861.661296:0:15016:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788863861.661297:0:15016:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788863861.661299:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788863861.661302:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863861.661303:0:15016:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788863861.661306:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863861.661309:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863861.661310:0:15016:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788863861.661313:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788863861.661315:0:15016:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788863861.661317:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863861.661320:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863861.661321:0:15016:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788863861.661323:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788863861.661326:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863861.661327:0:15016:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788863861.661330:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788863861.661404:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788863861.661408:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788863861.661409:0:15016:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788863861.661412:0:15016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788863861.661613:0:15002:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788863861.661660:0:15002:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788863861.661692:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b400/0x744cd7666bbbbc5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc62 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.661706:0:15002:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b400/0x744cd7666bbbbc5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc62 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863861.661718:0:15002:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8becca5000 from 1 10000000:01000000:1.0:1788863861.661722:0:15002:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788863861.661778:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.661788:0:15002:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.661805:0:15002:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863861.661848:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788863861.662020:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863861.662066:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd01c5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788863861.662189:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324033408 00000100:00100000:0.0:1788863861.662199:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324033408 00000100:00100000:0.0:1788863861.662256:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788863861.662264:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+14:15002:x1875759324033408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863861.662279:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863861.662294:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bff18be00/0x744cd7666bbbbc7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbc77 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863861.662327:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bff18be00/0x744cd7666bbbbc7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbc77 expref: 15 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863861.662337:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bff18be00/0x744cd7666bbbbc7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbc77 expref: 15 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863861.662348:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18be00, rc 0) 00000100:00100000:0.0:1788863861.662391:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+15:15002:x1875759324033408:12345-0@lo:101:mount.lustre.0 Request processed in 128us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863861.662397:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788863861.662552:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863861.662566:0:15002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc7e expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.662574:0:15002:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbc7e expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863861.663216:0:15002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788863861.663838:0:15002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788863861.664134:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788863861.664195:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788863861.664275:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788863861.664285:0:15002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788863861.664383:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863861.664445:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863861.664494:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd01c5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788863861.664689:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324033536 00000100:00100000:3.0:1788863861.664698:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324033536 00000100:00100000:3.0:1788863861.664751:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788863861.664761:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+15:15002:x1875759324033536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863861.665032:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+15:15002:x1875759324033536:12345-0@lo:501:mount.lustre.0 Request processed in 272us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863861.665040:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788863861.667790:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863861.668644:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863861.668745:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863861.668863:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd01c5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788863861.671039:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324033664 00000100:00100000:0.0:1788863861.671053:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324033664 00000100:00100000:0.0:1788863861.671110:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788863861.671119:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+15:15002:x1875759324033664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863861.671428:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+15:15002:x1875759324033664:12345-0@lo:503:mount.lustre.0 Request processed in 309us (2682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863861.671437:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788863861.671575:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033664:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788863861.672212:0:15002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788863861.672297:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863861.672367:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863861.672413:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd01c5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788863861.672601:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324033792 00000100:00100000:0.0:1788863861.672609:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324033792 00000100:00100000:0.0:1788863861.672652:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788863861.672662:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+15:15002:x1875759324033792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863861.672841:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+15:15002:x1875759324033792:12345-0@lo:502:mount.lustre.0 Request processed in 181us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863861.672872:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788863861.673022:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863861.673304:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788863861.673363:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788863861.673414:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788863861.673453:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788863861.673489:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788863861.673635:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788863861.673675:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788863861.673706:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788863861.673749:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863861.673809:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863861.673964:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd01c5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788863861.677039:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324033920 00000100:00100000:0.0:1788863861.677060:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324033920 00000100:00100000:0.0:1788863861.677599:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788863861.677615:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+15:15002:x1875759324033920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863861.678611:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+15:15002:x1875759324033920:12345-0@lo:502:mount.lustre.0 Request processed in 994us (4795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863861.678628:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788863861.681699:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324033920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863861.682011:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788863861.682032:0:15002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788863861.683080:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863861.683096:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863861.683099:0:15020:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788863861.683107:0:15020:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8becca5000 00000020:00000080:1.0:1788863861.683109:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788863861.683117:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863861.683120:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863861.683122:0:15020:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788863861.683124:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863861.683126:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863861.683128:0:15020:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788863861.683132:0:15020:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8becca5000 00000020:00000080:1.0:1788863861.683134:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788863861.683211:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863861.683215:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863861.683217:0:15020:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788863861.683220:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863861.683222:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863861.683223:0:15020:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788863861.683228:0:15020:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8becca5000 00000020:00000080:1.0:1788863861.683230:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788863861.683262:0:15020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863861.683266:0:15020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863861.683267:0:15020:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788863861.683270:0:15020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788863861.692821:0:15002:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788863861.692892:0:15002:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788863861.692925:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc7e expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.692941:0:15002:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc7e expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863861.693011:0:15002:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788863861.693015:0:15002:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8becca5000 10000000:01000000:2.0:1788863861.693019:0:15002:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8becca5000 10000000:01000000:2.0:1788863861.693024:0:15002:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788863861.693030:0:15002:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e8becca5000 from 1 10000000:01000000:2.0:1788863861.693033:0:15002:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788863861.693082:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bee554a00/0x744cd7666bbbbc85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.693092:0:15002:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bee554a00/0x744cd7666bbbbc85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.693106:0:15002:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bee554a00/0x744cd7666bbbbc85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863861.693140:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca960a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324034048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788863861.693261:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863861.693320:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd2875a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788863861.693741:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324034048 00000100:00100000:1.0:1788863861.693751:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324034048 00000100:00100000:1.0:1788863861.693815:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788863861.693827:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+15:15002:x1875759324034048:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788863861.693874:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863861.693891:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbbc8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbc85 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.693920:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbbc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbc85 expref: 16 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.693931:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7aa00/0x744cd7666bbbbc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbc85 expref: 16 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.693940:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7aa00, rc 0) 00000100:00100000:1.0:1788863861.693991:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15002:x1875759324034048:12345-0@lo:101:mount.lustre.0 Request processed in 166us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863861.693999:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788863861.696722:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca960a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324034048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863861.696753:0:15002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bee554a00/0x744cd7666bbbbc85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc8c expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.696775:0:15002:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bee554a00/0x744cd7666bbbbc85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbc8c expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788863861.697485:0:15002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788863861.699243:0:15002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788863861.702738:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788863861.702869:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788863861.702905:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788863861.702966:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788863861.703001:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788863861.703046:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788863861.703082:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788863861.703188:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788863861.703280:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788863861.703322:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788863861.703359:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788863861.703410:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788863861.703446:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788863861.703479:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788863861.706894:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788863861.707010:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788863861.707046:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788863861.707091:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788863861.707123:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788863861.707152:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788863861.707213:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788863861.707249:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788863861.707281:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788863861.707324:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788863861.707379:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788863861.707412:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788863861.707474:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788863861.708941:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788863861.709110:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788863861.709119:0:15002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788863861.709256:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca960a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324034176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863861.709325:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863861.713358:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd2875a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863861.716569:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324034176 00000100:00100000:0.0:1788863861.716582:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324034176 00000100:00100000:0.0:1788863861.716632:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788863861.716641:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15002:x1875759324034176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863861.717020:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15002:x1875759324034176:12345-0@lo:501:mount.lustre.0 Request processed in 379us (7694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863861.717028:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788863861.717272:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca960a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324034176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863861.717331:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca960a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324034304:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788863861.717386:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863861.717419:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324034304 00000100:00100000:2.0:1788863861.717424:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324034304 00000100:00100000:2.0:1788863861.717456:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788863861.717462:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15002:x1875759324034304:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788863861.717688:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15002:x1875759324034304:12345-0@lo:503:mount.lustre.0 Request processed in 224us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863861.717696:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788863861.717747:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd2875a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863861.717762:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca960a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324034304:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788863861.719459:0:15002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788863861.720008:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca960a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324034432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863861.720098:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863861.720201:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd2875a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863861.722999:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324034432 00000100:00100000:0.0:1788863861.723014:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324034432 00000100:00100000:0.0:1788863861.723067:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788863861.723076:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15002:x1875759324034432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863861.723398:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15002:x1875759324034432:12345-0@lo:502:mount.lustre.0 Request processed in 321us (3299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863861.723407:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788863861.723601:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca960a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324034432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788863861.723951:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788863861.724009:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788863861.724044:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788863861.724093:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788863861.724130:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788863861.724204:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788863861.724236:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788863861.724262:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788863861.724303:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788863861.724335:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788863861.724366:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788863861.724411:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788863861.724464:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788863861.724503:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788863861.724966:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788863861.725006:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788863861.725040:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788863861.725085:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788863861.725119:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788863861.725152:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788863861.725209:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788863861.725242:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788863861.725278:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788863861.725328:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788863861.725366:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788863861.725401:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788863861.725449:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788863861.725484:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788863861.725657:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788863861.725711:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788863861.725748:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788863861.725784:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788863861.725818:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788863861.727947:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788863861.728596:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788863861.728661:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788863861.728690:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788863861.728716:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788863861.728784:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788863861.728816:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788863861.728907:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324034560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788863861.728997:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863861.729051:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324034560 00000100:00100000:3.0:1788863861.729059:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324034560 00000100:00100000:3.0:1788863861.729106:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788863861.729114:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15002:x1875759324034560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863861.730936:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd2849300 going to sleep for 11 seconds 00000100:00100000:3.0:1788863861.731319:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15002:x1875759324034560:12345-0@lo:502:mount.lustre.0 Request processed in 2199us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863861.731332:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788863861.731459:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324034560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788863861.731611:0:15002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788863861.731638:0:15002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788863861.737934:0:15025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788863861.737966:0:15025:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e8bff0319c0) 00000020:00000080:1.0:1788863861.737999:0:15025:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788863861.738118:0:15025:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8becca5000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788863861.738124:0:15025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8becca5000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788863861.738127:0:15025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8becca5000 3 00010000:00080000:1.0:1788863861.738177:0:15025:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8bfd0d9800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788863861.742032:0:15025:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788863861.742323:0:15025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788863861.742370:0:15025:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788863861.742454:0:15025:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x744cd7666bbbbc9a 00000100:00080000:1.0:1788863861.742467:0:15025:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788863861.742480:0:15025:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e8bfd0d9800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788863861.742696:0:15025:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bc8517100 x1875759324034688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863861.742750:0:15025:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788863861.742787:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863861.742792:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863861.742795:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863861.742798:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788863861.742843:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863861.742879:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759324034816:0@lo:400:kworker.0 00000100:00100000:1.0:1788863861.742948:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863861.743001:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324034816 00000100:00100000:1.0:1788863861.743008:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324034816 00000100:00100000:2.0:1788863861.743111:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875759324034688:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788863861.743147:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863861.743278:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324034688 00000100:00100000:1.0:1788863861.743283:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324034688 00000100:00100000:1.0:1788863861.743299:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863861.743309:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759324034816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863861.743376:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759324034816:12345-0@lo:400:kworker.0 Request processed in 67us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863861.743382:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863861.743400:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863861.743404:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875759324034688:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788863861.743428:0:14320:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:1.0:1788863861.743464:0:14320:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x744cd7666bbbbca1 00000004:00100000:1.0:1788863861.743482:0:14320:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788863861.743651:0:14320:0:(import.c:65:import_set_state_nolock()) ffff8e8ac19c4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863861.743700:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875759324034688:12345-0@lo:38:llog_process_th.0 Request processed in 294us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863861.743714:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788863861.743756:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8bc8516680 x1875759324034816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863861.743771:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759324034816:0@lo:400:kworker.0 00010000:00080000:2.0:1788863861.744126:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8bc8517100 x1875759324034688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863861.744134:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788863861.744141:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788863861.744147:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788863861.744151:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788863861.744153:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bfd0d9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788863861.744158:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875759324034688:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788863861.744238:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788863861.753220:0:15002:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788863861.753272:0:15002:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788863861.753305:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bee554a00/0x744cd7666bbbbc85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc8c expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.753321:0:15002:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bee554a00/0x744cd7666bbbbc85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbc8c expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788863861.753572:0:15002:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788863861.753575:0:15002:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788863861.753577:0:15002:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863861.753578:0:15002:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863861.753579:0:15002:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863861.753581:0:15002:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863861.753583:0:15002:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863861.753584:0:15002:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863861.753586:0:15002:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788863861.753589:0:15002:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788863861.753592:0:15002:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788863861.753593:0:15002:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788863861.753594:0:15002:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863861.753595:0:15002:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863861.753596:0:15002:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863861.753598:0:15002:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863861.753599:0:15002:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863861.753600:0:15002:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863861.753601:0:15002:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788863861.753631:0:15002:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788863861.753653:0:15002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324034944:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788863861.753724:0:15002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863861.753804:0:15002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd23ae9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863861.760808:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324034944 00000100:00100000:2.0:1788863861.760823:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324034944 00000100:00100000:2.0:1788863861.760995:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788863861.761006:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15002:x1875759324034944:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788863861.761114:0:14312:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788863861.761132:0:14312:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788863861.791256:0:14312:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788863861.791276:0:14312:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788863861.792433:0:14334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788863861.792445:0:14334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788863861.792481:0:14334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.792539:0:14334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bff18aa00/0x744cd7666bbbbc15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbc0e expref: 16 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.792549:0:14334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.792614:0:14334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bff18aa00/0x744cd7666bbbbc15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbbc0e expref: 16 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.792631:0:14334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bff18aa00/0x744cd7666bbbbc15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbbc0e expref: 16 pid: 14311 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863861.792650:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14334:1875759324035072:0@lo:104: 00000100:00100000:1.0:1788863861.792740:0:14334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863861.792839:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd23aea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788863861.796815:0:14301:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324035072 00000100:00100000:2.0:1788863861.796839:0:14301:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324035072 00000100:00100000:2.0:1788863861.796934:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863861.796948:0:14301:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:98ce9f4a-6069-439b-828d-fac2605e9de4+3:14334:x1875759324035072:12345-0@lo:104: 00010000:00010000:2.0:1788863861.796979:0:14301:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbc15 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.797202:0:14301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788863861.797209:0:14301:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:98ce9f4a-6069-439b-828d-fac2605e9de4+3:14334:x1875759324035072:12345-0@lo:104: Request processed in 265us (4470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863861.797217:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788863861.797249:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863861.797257:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbc15 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.797265:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a000 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:2.0:1788863861.797271:0:14307:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbbc15 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.797281:0:14307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbbc15 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863861.797291:0:14307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbbc15 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863861.797298:0:14307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788863861.797352:0:14307:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbc15 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.797358:0:14307:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863861.797402:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbc15 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.797409:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7a000/0x744cd7666bbbbc0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbc15 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.797432:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863861.797435:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863861.797437:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863861.797582:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14334:1875759324035072:0@lo:104: 00010000:00010000:1.0:1788863861.797623:0:14334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863861.797657:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324035200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863861.797712:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863861.798697:0:14303:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324035200 00000100:00100000:2.0:1788863861.798708:0:14303:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324035200 00010000:00010000:2.0:1788863861.798745:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bff18aa00/0x744cd7666bbbbc15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbc0e expref: 17 pid: 14311 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863861.798777:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863861.798785:0:14303:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98ce9f4a-6069-439b-828d-fac2605e9de4+17:3307:x1875759324035200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863861.798801:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863861.798806:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bff18aa00/0x744cd7666bbbbc15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbc0e expref: 17 pid: 14311 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.798818:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bff18aa00/0x744cd7666bbbbc15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbbc0e expref: 17 pid: 14311 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.798837:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bff18aa00/0x744cd7666bbbbc15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbbc0e expref: 17 pid: 14311 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.798872:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.798881:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788863861.798914:0:14303:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006469820s 00010000:00010000:2.0:1788863861.798919:0:14303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.798926:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.798933:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.798940:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.798947:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863861.798953:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.798962:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.798978:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863861.798987:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863861.799467:0:14334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.799477:0:14334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863861.799483:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7a400/0x744cd7666bbbbca8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863861.800251:0:14303:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98ce9f4a-6069-439b-828d-fac2605e9de4+16:3307:x1875759324035200:12345-0@lo:103:ldlm_bl.0 Request processed in 1460us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863861.800263:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788863861.801968:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324035200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863861.805639:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+15:15002:x1875759324034944:12345-0@lo:253:mount.lustre.0 Request processed in 44616us (51895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863861.805664:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788863861.805890:0:15002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15002:1875759324034944:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788863861.805910:0:15002:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788863861.805914:0:15002:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788863861.805916:0:15002:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788863861.805918:0:15002:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863861.805919:0:15002:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863861.805920:0:15002:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863861.805921:0:15002:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863861.805922:0:15002:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788863861.805924:0:15002:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863861.805926:0:15002:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788863861.805943:0:15002:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788863861.813012:0:15002:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788863861.813722:0:15002:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788863861.813935:0:15002:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788863861.814100:0:15002:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788863861.814271:0:15002:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788863861.814518:0:15002:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788863861.816612:0:15002:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788863861.889829:0:15002:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788863861.889839:0:15002:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788863861.889957:0:15002:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788863861.890035:0:15002:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788863861.890050:0:15002:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788863861.890085:0:15002:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788863861.910804:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788863862.872242:0:14316:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788863862.872258:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e8bfb3af800 from 7 10000000:01000000:3.0:1788863862.872269:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788863862.872353:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863862.872370:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863862.872387:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863862.872432:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324035328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788863862.872564:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863862.872641:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bff235e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863862.875039:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324035328 00000100:00100000:0.0:1788863862.875064:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324035328 00000100:00100000:0.0:1788863862.875166:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788863862.875177:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+15:14316:x1875759324035328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863862.875200:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863862.875230:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bff18b800/0x744cd7666bbbbcb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbcaf expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863862.875292:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bff18b800/0x744cd7666bbbbcb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbcaf expref: 16 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863862.875306:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bff18b800/0x744cd7666bbbbcb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbcaf expref: 16 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863862.875319:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bff18b800, rc 0) 00000100:00100000:0.0:1788863862.875453:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+16:14316:x1875759324035328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 278us (2891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863862.875461:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788863862.878799:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324035328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863862.878870:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbcb6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863862.878890:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbcb6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863862.879033:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324035456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788863862.879167:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863862.879240:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd23aed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863862.884119:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324035456 00000100:00100000:0.0:1788863862.884155:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324035456 00000100:00100000:0.0:1788863862.884250:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788863862.884263:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+16:14316:x1875759324035456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788863862.884303:0:14312:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788863862.884335:0:14312:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788863862.884339:0:14312:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788863862.884541:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+16:14316:x1875759324035456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 280us (5373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863862.884550:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788863862.884686:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324035456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788863862.884827:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788863862.884845:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbcb6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863862.884889:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbcb6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863862.935843:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863863.958632:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863864.982492:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863866.008150:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863866.390705:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788863866.970392:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863866.970401:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863866.970404:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788863866.970407:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788863866.970490:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98ce9f4a-6069-439b-828d-fac2605e9de4:3308:1875759324035584:0@lo:400:kworker.0 00000100:00100000:1.0:1788863866.970584:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863866.970667:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863866.970674:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324035712:0@lo:400:kworker.0 00000100:00100000:1.0:1788863866.970707:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863866.970755:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324035840:0@lo:400:kworker.0 00000100:00100000:1.0:1788863866.970782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863866.970819:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324035584 00000100:00100000:1.0:1788863866.970829:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324035584 00000100:00100000:1.0:1788863866.970920:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788863866.970929:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+16:3308:x1875759324035584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863866.970983:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+16:3308:x1875759324035584:12345-0@lo:400:kworker.0 Request processed in 55us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863866.970992:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788863866.971029:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324035712 00000100:00100000:1.0:1788863866.971034:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324035712 00000100:00100000:1.0:1788863866.971070:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324035840 00000100:00100000:1.0:1788863866.971073:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324035840 00000100:00100000:1.0:1788863866.971102:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863866.971108:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324035712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863866.971144:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324035712:12345-0@lo:400:kworker.0 Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863866.971151:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863866.971163:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863866.971169:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759324035840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863866.971199:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759324035840:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863866.971205:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788863866.971252:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bc8514e00 x1875759324035840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863866.971268:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324035840:0@lo:400:kworker.0 00010000:00080000:1.0:1788863866.971302:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bc8515c00 x1875759324035712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863866.971311:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324035712:0@lo:400:kworker.0 00000100:00100000:1.0:1788863866.971331:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98ce9f4a-6069-439b-828d-fac2605e9de4:3308:1875759324035584:0@lo:400:kworker.0 00000100:00080000:0.0:1788863866.973006:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788863867.030146:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863868.054409:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863869.081272:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788863869.848536:0:15370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788863869.974016:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863854/real 1788863854] req@ffff8e8bc8514700 x1875759324031104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863869 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863869.974067:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8bc8514700 x1875759324031104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863869 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863869.974087:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863854/real 1788863854] req@ffff8e8bc8516d80 x1875759324031232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863869 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863869.974100:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8bc8516d80 x1875759324031232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788863869 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788863869.974119:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bee4d0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788863869.974143:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788863869.974148:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324031104:0@lo:8:kworker.0 00000100:00080000:3.0:1788863869.974155:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff0c5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788863869.974162:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788863869.974165:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324031232:0@lo:8:kworker.0 00000100:00080000:0.0:1788863869.974380:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863869.974401:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788863869.974418:0:38:0:(import.c:65:import_set_state_nolock()) ffff8e8bee4d0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863869.974426:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:0.0:1788863869.974435:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788863869.974453:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8bee4d0000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788863869.974500:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bcabde300 x1875759324036096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863869.974526:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863869.974531:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788863869.974534:0:38:0:(import.c:65:import_set_state_nolock()) ffff8e8bff0c5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863869.974540:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:0.0:1788863869.974545:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788863869.974552:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8bff0c5800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788863869.974574:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bcabdf100 x1875759324036224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863869.974814:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863869.974841:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98ce9f4a-6069-439b-828d-fac2605e9de4:3306:1875759324035968:0@lo:400:kworker.0 00000100:00100000:1.0:1788863869.974995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863869.975064:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324036352:0@lo:400:kworker.0 00000100:00100000:1.0:1788863869.975089:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863869.975110:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863869.975116:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324036480:0@lo:400:kworker.0 00000100:00100000:1.0:1788863869.975135:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863869.975166:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324036352 00000100:00100000:1.0:1788863869.975175:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324036352 00000100:00100000:1.0:1788863869.975229:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324036480 00000100:00100000:1.0:1788863869.975235:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324036480 00000100:00100000:1.0:1788863869.975295:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863869.975315:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324036352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863869.975439:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324036352:12345-0@lo:400:kworker.0 Request processed in 127us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863869.975453:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863869.975476:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863869.975482:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324036480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863869.975509:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324036480:12345-0@lo:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863869.975514:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788863869.975539:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788863869.975563:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bcabdd500 x1875759324036480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863869.975590:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324036480:0@lo:400:kworker.0 00010000:00080000:1.0:1788863869.975603:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bcabddf80 x1875759324036352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863869.975611:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324036352:0@lo:400:kworker.0 00000100:00100000:0.0:1788863869.975815:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324035968 00000100:00100000:0.0:1788863869.975820:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324035968 00000100:00100000:0.0:1788863869.975878:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788863869.975884:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+16:3306:x1875759324035968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863869.975923:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+16:3306:x1875759324035968:12345-0@lo:400:kworker.0 Request processed in 40us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863869.975929:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788863869.976108:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324036096:0@lo:8:kworker.0 00000100:00100000:3.0:1788863869.976145:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863869.976182:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324036224:0@lo:8:kworker.0 00000100:00100000:3.0:1788863869.976204:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863869.976327:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324036096 00000100:00100000:1.0:1788863869.976331:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324036096 00000100:00100000:1.0:1788863869.976357:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324036224 00000100:00100000:1.0:1788863869.976360:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324036224 00000100:00100000:1.0:1788863869.976370:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863869.976374:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875759324036096:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788863869.976511:0:15005:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:1.0:1788863869.976546:0:15005:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x744cd7666bbbbcbd 00002000:00100000:1.0:1788863869.976559:0:15005:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e8ac19c2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788863869.976564:0:15005:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788863869.976566:0:15005:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788863869.977106:0:15005:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788863869.977133:0:15005:0:(import.c:65:import_set_state_nolock()) ffff8e8ac19c7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863869.977190:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875759324036096:12345-0@lo:8:kworker.0 Request processed in 813us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863869.977196:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788863869.977218:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863869.977222:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875759324036224:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788863869.977234:0:15005:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788863869.977260:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875759324036224:12345-0@lo:8:kworker.0 Request processed in 37us (1054us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788863869.977278:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863869.977319:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98ce9f4a-6069-439b-828d-fac2605e9de4:3306:1875759324035968:0@lo:400:kworker.0 00010000:00080000:3.0:1788863869.977786:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bcabde300 x1875759324036096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788863889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863869.977805:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788863869.977820:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788863869.977836:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788863869.977848:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788863869.977918:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bee4d0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788863869.977955:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788863869.977963:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324036096:0@lo:8:kworker.0 00000100:00080000:3.0:1788863869.977978:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff0c5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788863869.977982:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788863869.977985:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324036224:0@lo:8:kworker.0 00000004:00080000:3.0:1788863869.978023:0:14340:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788863869.978542:0:14340:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 499107687381ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788863869.985094:0:14341:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788863869.985128:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14341:1875759324036736:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788863869.985206:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863869.985240:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc1370900 going to sleep for 11 seconds 00000100:00100000:0.0:1788863869.985366:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863869.985381:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324036608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863869.985423:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863869.985467:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324036608 00000100:00100000:0.0:1788863869.985475:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324036608 00000100:00100000:0.0:1788863869.985539:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863869.985549:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875759324036608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863869.985590:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863869.985635:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875759324036608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863869.985641:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788863869.985664:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788863869.985691:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bcabdf480 x1875759324036608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863869.985711:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324036608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863869.985738:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324036736 00000100:00100000:0.0:1788863869.985744:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324036736 00000100:00100000:0.0:1788863869.985765:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788863869.985771:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14341:x1875759324036736:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788863869.990052:0:15005:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788863869.990063:0:15005:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788863869.990068:0:15005:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1788863870.025824:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.025846:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbcc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.025901:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.025913:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.025920:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbcc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.025943:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbcc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.025957:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbcc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.025966:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbcc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.025996:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863870.026026:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863870.026032:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbcc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026040:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18ae00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863870.026044:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbcc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026053:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbcc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026071:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbcc4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026101:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbcc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026121:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.026123:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.026125:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.026736:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.026743:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbccb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026753:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.026757:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.026762:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbccb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026774:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbccb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026783:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbccb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026790:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbccb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026809:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863870.026820:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863870.026830:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbccb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026837:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18bc00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863870.026840:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbccb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026847:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbccb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026881:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbccb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026888:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbccb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.026901:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.026903:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.026905:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.027320:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.027326:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbcd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.027334:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.027338:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.027342:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbcd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.027365:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbcd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.027373:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbcd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.027380:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbcd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.031266:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863870.031313:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863870.031323:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbcd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.031336:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863870.031342:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbcd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.031354:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbcd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.031383:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbcd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.033561:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbcd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.033656:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.033661:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.033665:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.036032:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.036045:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbcd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.036061:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.036066:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.036071:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbcd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.037534:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbcd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.037554:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbcd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.037562:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbcd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.037611:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863870.037624:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863870.037629:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbcd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.037650:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18aa00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863870.037655:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbcd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.037664:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbcd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.037680:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbcd9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.037687:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbcd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.037708:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.037710:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.037712:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.045012:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.045030:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbce0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.045053:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.045058:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.045065:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.046051:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.046314:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.046327:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.046359:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863870.047116:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863870.047125:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.047136:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18bc00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863870.047141:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.047152:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbce0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.047180:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbce0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.047187:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ba9dd48/0x744cd7666bbbbce0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.047213:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.047215:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.047217:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.048314:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.048324:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbce7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048337:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.048342:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.048360:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048375:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048384:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048401:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbce7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048431:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863870.048445:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863870.048450:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbce7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048458:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18ae00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863870.048461:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbce7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048471:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbce7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048484:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbce7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048492:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7bed38a/0x744cd7666bbbbce7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048507:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.048509:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.048511:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.048952:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.048958:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db471d27/0x744cd7666bbbbcee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048967:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.048976:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.048981:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db471d27/0x744cd7666bbbbcee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048990:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db471d27/0x744cd7666bbbbcee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.048998:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db471d27/0x744cd7666bbbbcee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049016:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db471d27/0x744cd7666bbbbcee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049034:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863870.049043:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863870.049047:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db471d27/0x744cd7666bbbbcee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049055:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863870.049059:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db471d27/0x744cd7666bbbbcee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049066:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db471d27/0x744cd7666bbbbcee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049086:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db471d27/0x744cd7666bbbbcee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049107:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db471d27/0x744cd7666bbbbcee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049120:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.049122:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.049123:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.049522:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.049528:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c5caad/0x744cd7666bbbbcf5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049537:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.049540:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.049544:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c5caad/0x744cd7666bbbbcf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049553:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c5caad/0x744cd7666bbbbcf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049560:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c5caad/0x744cd7666bbbbcf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049567:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082c5caad/0x744cd7666bbbbcf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049582:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863870.049590:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863870.049600:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082c5caad/0x744cd7666bbbbcf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049607:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18ba00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863870.049610:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c5caad/0x744cd7666bbbbcf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049619:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c5caad/0x744cd7666bbbbcf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049630:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082c5caad/0x744cd7666bbbbcf5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049637:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c5caad/0x744cd7666bbbbcf5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.049649:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.049651:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.049652:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.050080:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.050086:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000974e1151/0x744cd7666bbbbcfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050094:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.050097:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.050101:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000974e1151/0x744cd7666bbbbcfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050121:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000974e1151/0x744cd7666bbbbcfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050132:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000974e1151/0x744cd7666bbbbcfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050138:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000974e1151/0x744cd7666bbbbcfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050152:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863870.050161:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863870.050165:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000974e1151/0x744cd7666bbbbcfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050172:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863870.050175:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000974e1151/0x744cd7666bbbbcfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050182:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000974e1151/0x744cd7666bbbbcfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050193:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000974e1151/0x744cd7666bbbbcfc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050201:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000974e1151/0x744cd7666bbbbcfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050221:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.050222:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.050224:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.050632:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.050639:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbbd03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050647:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.050650:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.050654:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbbd03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050663:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbbd03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050670:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbbd03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050677:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbbd03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050691:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863870.050700:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863870.050703:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbbd03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050720:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863870.050724:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbbd03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050732:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbbd03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050743:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbbd03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050750:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85d1150/0x744cd7666bbbbd03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.050765:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.050766:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.050768:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.057038:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.057054:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbd0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.057073:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.057078:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.057083:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbd0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.057099:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbd0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.057116:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbd0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.057123:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbd0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.057147:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863870.057511:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863870.057519:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbd0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.057540:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18aa00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863870.057545:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbd0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.057553:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbd0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.057571:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbd0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.057577:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039cc2167/0x744cd7666bbbbd0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.057594:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.057596:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.057598:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.058107:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.058114:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbd11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.058123:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.058127:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.058131:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbd11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.058142:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbd11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.058149:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbd11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.058156:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbd11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.058183:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863870.058483:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863870.058489:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbd11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.058497:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18a200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863870.058500:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbd11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.058509:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbd11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.058528:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbd11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.058535:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b880148/0x744cd7666bbbbd11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.058551:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.058553:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.058554:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.060240:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.060254:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbbd18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.060268:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.060272:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.060277:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbbd18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.060289:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbbd18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.060298:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbbd18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.060305:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbbd18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.060361:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788863870.060917:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.060924:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5d27543/0x744cd7666bbbbd1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.060935:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.060944:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.060949:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d27543/0x744cd7666bbbbd1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.060958:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5d27543/0x744cd7666bbbbd1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.060966:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5d27543/0x744cd7666bbbbd1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.060973:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d27543/0x744cd7666bbbbd1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.064886:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863870.064903:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbbd18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.064916:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863870.064921:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbbd18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.064933:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbbd18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.064965:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbbd18 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.064973:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad6c8c47/0x744cd7666bbbbd18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.065037:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863870.065041:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5d27543/0x744cd7666bbbbd1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.065047:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18b600 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863870.065051:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5d27543/0x744cd7666bbbbd1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.065058:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5d27543/0x744cd7666bbbbd1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.065068:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5d27543/0x744cd7666bbbbd1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.065075:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.065087:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.065090:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.065554:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788863870.065563:0:15005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5d27543/0x744cd7666bbbbd1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863870.066537:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.066547:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.066561:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.066566:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.066574:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.066587:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.066604:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.066612:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.071929:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863870.071953:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.071971:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe995400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863870.071979:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.072026:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.072062:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.073203:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.073215:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.073221:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.074058:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788863870.074074:0:15005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788863870.074321:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788863870.075088:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.075097:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.075111:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.075116:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.075123:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.075136:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.075146:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.075164:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.075185:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863870.075197:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863870.075202:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.075210:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe995800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863870.075214:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.075223:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.075239:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd2d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.075246:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.075259:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.075261:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.075263:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863870.076430:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863870.083242:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863870.083259:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cccdf19/0x744cd7666bbbbd34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.083281:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1788863870.083286:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863870.083292:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cccdf19/0x744cd7666bbbbd34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.083308:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cccdf19/0x744cd7666bbbbd34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.083318:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cccdf19/0x744cd7666bbbbd34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.083326:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cccdf19/0x744cd7666bbbbd34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.083696:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863870.084504:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863870.084518:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cccdf19/0x744cd7666bbbbd34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.084534:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863870.084542:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cccdf19/0x744cd7666bbbbd34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.084556:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cccdf19/0x744cd7666bbbbd34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.084594:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cccdf19/0x744cd7666bbbbd34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.084606:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cccdf19/0x744cd7666bbbbd34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.084648:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863870.084652:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863870.084655:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863870.085729:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863870.085745:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d426033/0x744cd7666bbbbd3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.085769:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1788863870.085776:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863870.085787:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d426033/0x744cd7666bbbbd3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.085813:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d426033/0x744cd7666bbbbd3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.085830:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d426033/0x744cd7666bbbbd3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.085842:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d426033/0x744cd7666bbbbd3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.085915:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788863870.086475:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863870.086481:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad4c2417/0x744cd7666bbbbd42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.086491:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1788863870.086493:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863870.086498:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad4c2417/0x744cd7666bbbbd42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.086520:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad4c2417/0x744cd7666bbbbd42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.086528:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad4c2417/0x744cd7666bbbbd42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.086534:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad4c2417/0x744cd7666bbbbd42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.087167:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788863870.087338:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863870.087355:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d426033/0x744cd7666bbbbd3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.087365:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863870.087376:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d426033/0x744cd7666bbbbd3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.087385:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d426033/0x744cd7666bbbbd3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.087412:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d426033/0x744cd7666bbbbd3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.087420:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d426033/0x744cd7666bbbbd3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.087437:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863870.087440:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad4c2417/0x744cd7666bbbbd42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.087446:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a600 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863870.087449:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad4c2417/0x744cd7666bbbbd42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.087456:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad4c2417/0x744cd7666bbbbd42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.087466:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad4c2417/0x744cd7666bbbbd42 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.087473:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad4c2417/0x744cd7666bbbbd42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863870.087492:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863870.087493:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863870.087495:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.090755:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863870.091635:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863870.091646:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010406899/0x744cd7666bbbbd49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.091665:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1788863870.091669:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863870.091676:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010406899/0x744cd7666bbbbd49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.091691:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010406899/0x744cd7666bbbbd49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.091702:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010406899/0x744cd7666bbbbd49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.091721:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010406899/0x744cd7666bbbbd49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.091744:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788863870.092366:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863870.092374:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000df3e69d/0x744cd7666bbbbd50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092384:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1788863870.092459:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863870.092465:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000df3e69d/0x744cd7666bbbbd50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092477:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000df3e69d/0x744cd7666bbbbd50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092485:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000df3e69d/0x744cd7666bbbbd50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092492:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000df3e69d/0x744cd7666bbbbd50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092512:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788863870.092530:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863870.092536:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010406899/0x744cd7666bbbbd49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092552:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863870.092557:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010406899/0x744cd7666bbbbd49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092565:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010406899/0x744cd7666bbbbd49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092584:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010406899/0x744cd7666bbbbd49 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092591:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010406899/0x744cd7666bbbbd49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092608:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863870.092612:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000df3e69d/0x744cd7666bbbbd50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092617:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863870.092620:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000df3e69d/0x744cd7666bbbbd50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092627:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000df3e69d/0x744cd7666bbbbd50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092635:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000df3e69d/0x744cd7666bbbbd50 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092649:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000df3e69d/0x744cd7666bbbbd50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.092661:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.092663:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.092665:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863870.093113:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863870.093119:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e68c5d99/0x744cd7666bbbbd57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.093128:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1788863870.093132:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863870.093136:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e68c5d99/0x744cd7666bbbbd57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.093146:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e68c5d99/0x744cd7666bbbbd57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.093154:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e68c5d99/0x744cd7666bbbbd57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.093162:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e68c5d99/0x744cd7666bbbbd57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.093178:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863870.093186:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863870.093196:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e68c5d99/0x744cd7666bbbbd57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.093203:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ae00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863870.093206:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68c5d99/0x744cd7666bbbbd57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.093214:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68c5d99/0x744cd7666bbbbd57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.093224:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e68c5d99/0x744cd7666bbbbd57 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.093230:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e68c5d99/0x744cd7666bbbbd57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863870.093242:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.093244:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863870.093245:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.093978:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.096130:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.096167:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.096193:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.096202:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.096214:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.096244:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.096261:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.096273:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.096611:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788863870.099376:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.099591:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.099613:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.099618:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.099624:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.099645:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.099667:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.099674:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.099747:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788863870.099758:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.099766:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe995800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863870.099774:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.099792:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.099829:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd5e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.099843:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001913d33/0x744cd7666bbbbd5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.101127:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863870.101133:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.101141:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe995400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863870.101145:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.101153:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.101171:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd65 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.101179:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.101181:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.101184:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.102109:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788863870.102122:0:15005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbd65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.103513:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.103521:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.103644:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.103653:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000463e05a/0x744cd7666bbbbd6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.103668:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.103672:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.103678:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000463e05a/0x744cd7666bbbbd6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.103692:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000463e05a/0x744cd7666bbbbd6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.103702:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000463e05a/0x744cd7666bbbbd6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.103735:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000463e05a/0x744cd7666bbbbd6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.103775:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788863870.104333:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.104339:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b412f9b/0x744cd7666bbbbd73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.104349:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.104352:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.104356:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b412f9b/0x744cd7666bbbbd73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.104366:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b412f9b/0x744cd7666bbbbd73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.104374:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b412f9b/0x744cd7666bbbbd73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.104382:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b412f9b/0x744cd7666bbbbd73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.104613:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863870.104620:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000463e05a/0x744cd7666bbbbd6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.104630:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe995a00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863870.104634:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000463e05a/0x744cd7666bbbbd6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.104655:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000463e05a/0x744cd7666bbbbd6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.104673:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000463e05a/0x744cd7666bbbbd6c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.104681:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000463e05a/0x744cd7666bbbbd6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.104699:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.104701:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.104703:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863870.105586:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863870.106227:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863870.106236:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b412f9b/0x744cd7666bbbbd73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.106247:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe994a00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863870.106251:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b412f9b/0x744cd7666bbbbd73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.106261:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b412f9b/0x744cd7666bbbbd73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.106276:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b412f9b/0x744cd7666bbbbd73 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.106294:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b412f9b/0x744cd7666bbbbd73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.106313:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.106315:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.106316:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.106953:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.106960:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003863eefc/0x744cd7666bbbbd7a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.106979:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.106984:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.106990:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003863eefc/0x744cd7666bbbbd7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.107014:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003863eefc/0x744cd7666bbbbd7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.107025:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003863eefc/0x744cd7666bbbbd7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.107034:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003863eefc/0x744cd7666bbbbd7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.107050:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863870.108511:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863870.108522:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003863eefc/0x744cd7666bbbbd7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.108534:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe994200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863870.108539:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003863eefc/0x744cd7666bbbbd7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.108549:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003863eefc/0x744cd7666bbbbd7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.108571:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003863eefc/0x744cd7666bbbbd7a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.108578:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003863eefc/0x744cd7666bbbbd7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.108597:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.108599:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.108601:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863870.112175:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863870.112194:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000602bad0d/0x744cd7666bbbbd81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.112212:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788863870.112216:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863870.112223:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000602bad0d/0x744cd7666bbbbd81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.112238:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000602bad0d/0x744cd7666bbbbd81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.112260:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000602bad0d/0x744cd7666bbbbd81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.112267:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000602bad0d/0x744cd7666bbbbd81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863870.112292:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788863870.112706:0:15005:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1788863870.113541:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14341:x1875759324036736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 127764us (128329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863870.113552:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788863870.113739:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863870.113755:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000602bad0d/0x744cd7666bbbbd81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.113769:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe994800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863870.113774:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000602bad0d/0x744cd7666bbbbd81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.113789:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000602bad0d/0x744cd7666bbbbd81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.113818:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000602bad0d/0x744cd7666bbbbd81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.113830:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000602bad0d/0x744cd7666bbbbd81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863870.113907:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.113911:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863870.113913:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863870.118609:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14341:1875759324036736:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788863870.118631:0:14341:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788863870.118822:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14341:1875759324036864:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788863870.118933:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863870.118981:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8be6591cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863870.119075:0:15006:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324036864 00000100:00100000:3.0:1788863870.119082:0:15006:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324036864 00000100:00100000:3.0:1788863870.119132:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788863870.119141:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14341:x1875759324036864:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788863870.119190:0:15006:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788863870.131154:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14341:x1875759324036864:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12004us (12211us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788863870.131168:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788863870.131473:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14341:1875759324036864:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788863870.131492:0:14341:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1788863871.126523:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863872.157565:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788863872.282804:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788863872.282822:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1788863873.175196:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863874.198191:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788863875.165233:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863875.165241:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788863875.165254:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e8bff0c5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863875.165262:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:0.0:1788863875.165270:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788863875.165281:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8bff0c5800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788863875.165304:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bcabdca80 x1875759324037248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863875.165355:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324036992:0@lo:400:kworker.0 00000100:00100000:0.0:1788863875.165447:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863875.165502:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863875.165508:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759324037504:0@lo:400:kworker.0 00000100:00100000:0.0:1788863875.165542:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863875.165576:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324037120:0@lo:400:kworker.0 00000100:00100000:0.0:1788863875.165603:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863875.165621:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863875.165626:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324037376:0@lo:400:kworker.0 00000100:00100000:0.0:1788863875.165647:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863875.165675:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324037248:0@lo:8:kworker.0 00000100:00100000:0.0:1788863875.165701:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863875.165736:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324036992 00000100:00100000:0.0:1788863875.165746:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324036992 00000100:00100000:0.0:1788863875.165795:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788863875.165806:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+16:3307:x1875759324036992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863875.165917:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+16:3307:x1875759324036992:12345-0@lo:400:kworker.0 Request processed in 112us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863875.165925:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788863875.165973:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324037504 00000100:00100000:0.0:1788863875.165978:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324037504 00000100:00100000:0.0:1788863875.166013:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324037376 00000100:00100000:0.0:1788863875.166017:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324037376 00000100:00100000:0.0:1788863875.166031:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863875.166038:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759324037504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863875.166069:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759324037504:12345-0@lo:400:kworker.0 Request processed in 32us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863875.166075:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788863875.166094:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863875.166099:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324037376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863875.166131:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324037376:12345-0@lo:400:kworker.0 Request processed in 32us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863875.166137:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863875.166153:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324037120 00000100:00100000:0.0:1788863875.166157:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324037120 00000100:00100000:0.0:1788863875.166180:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324037248 00000100:00100000:0.0:1788863875.166183:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324037248 00000100:00100000:0.0:1788863875.166192:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863875.166199:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324037120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863875.166226:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324037120:12345-0@lo:400:kworker.0 Request processed in 28us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863875.166232:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863875.166243:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863875.166246:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875759324037248:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788863875.166264:0:15005:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788863875.169976:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bcabdf800 x1875759324037504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863875.169998:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759324037504:0@lo:400:kworker.0 00000100:00100000:2.0:1788863875.170012:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324036992:0@lo:400:kworker.0 00000100:00080000:1.0:1788863875.170931:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863875.170938:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863875.171102:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863875.171122:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324037632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863875.171200:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863875.171352:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324037632 00000100:00100000:3.0:1788863875.171360:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324037632 00000100:00100000:3.0:1788863875.171418:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788863875.171436:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324037632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863875.171476:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863875.171524:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324037632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863875.171530:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788863875.171611:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788863875.171634:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324037632:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788863875.186049:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bcabdea00 x1875759324037376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863875.186073:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324037376:0@lo:400:kworker.0 00000100:00100000:1.0:1788863875.186092:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324037120:0@lo:400:kworker.0 00000100:00100000:0.0:1788863875.214639:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875759324037248:12345-0@lo:8:kworker.0 Request processed in 48378us (48924us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788863875.214658:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788863875.222236:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff0c5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788863875.222258:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788863875.222266:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324037248:0@lo:8:kworker.0 00010000:00010000:2.0:1788863875.229961:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863876.254505:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863876.632980:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788863877.274896:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863878.294644:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788863878.972869:0:15722:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788863878.972874:0:15722:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788863878.973051:0:15722:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e8bf5bc0800 00000020:01000004:0.0:1788863878.973076:0:15722:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788863878.973093:0:15722:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788863878.973111:0:15722:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e8bf5bbb380) 00000020:00000080:0.0:1788863878.973130:0:15722:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788863878.994065:0:15722:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788863878.994436:0:15722:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788863878.995496:0:15722:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788863878.995814:0:15722:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788863878.996095:0:15722:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788863878.996506:0:15722:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 571: rc = 0 00100000:10000000:2.0:1788863878.996588:0:15722:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 571: rc = 0 00100000:10000000:2.0:1788863878.996678:0:15722:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 571: rc = 0 00100000:10000000:3.0:1788863878.998128:0:15722:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 502: rc = 0 00100000:10000000:3.0:1788863878.998699:0:15722:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 502: rc = 0 00100000:10000000:3.0:1788863878.999102:0:15722:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 502: rc = 0 00100000:10000000:3.0:1788863879.000096:0:15722:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 502: rc = 0 00100000:10000000:3.0:1788863879.000452:0:15722:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 502: rc = 0 00100000:10000000:3.0:1788863879.000800:0:15722:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 502: rc = 0 00000020:00000080:3.0:1788863879.001583:0:15722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788863879.001596:0:15722:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788863879.001612:0:15722:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x744cd7666bbbbd8f 00000020:01000004:3.0:1788863879.001624:0:15722:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788863879.001656:0:15722:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788863879.001663:0:15722:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788863879.001673:0:15722:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788863879.001707:0:15722:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788863879.001715:0:15722:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788863879.013468:0:15722:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788863879.013533:0:15722:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.151@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788863879.013538:0:15722:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788863879.013546:0:15722:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788863879.013547:0:15722:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863879.013548:0:15722:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863879.013549:0:15722:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863879.013550:0:15722:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863879.013552:0:15722:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788863879.013553:0:15722:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863879.013554:0:15722:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788863879.013558:0:15722:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788863879.013560:0:15722:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788863879.013561:0:15722:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788863879.013562:0:15722:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863879.013563:0:15722:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863879.013564:0:15722:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863879.013565:0:15722:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863879.013565:0:15722:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788863879.013566:0:15722:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863879.013567:0:15722:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788863879.013613:0:15722:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788863879.013643:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324037760:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788863879.014551:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863879.014884:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788863879.015032:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324037760 00000100:00100000:1.0:1788863879.015041:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324037760 00000100:00100000:1.0:1788863879.015346:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788863879.015363:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15722:x1875759324037760:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788863879.015409:0:14313:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788863879.015414:0:14313:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788863879.015420:0:14313:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788863879.039797:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15722:x1875759324037760:12345-0@lo:253:mount.lustre.0 Request processed in 24430us (25239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863879.039838:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788863879.040029:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324037760:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788863879.040053:0:15722:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788863879.040058:0:15722:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788863879.040062:0:15722:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788863879.040064:0:15722:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788863879.040065:0:15722:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788863879.040067:0:15722:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788863879.040068:0:15722:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788863879.040070:0:15722:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788863879.040072:0:15722:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788863879.040073:0:15722:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788863879.040107:0:15722:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8bf5bc0800 from lustre-OST0001 10000000:01000000:3.0:1788863879.040136:0:15722:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788863879.040140:0:15722:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788863879.040148:0:15722:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e8bc84b99c0 local copy 00010000:00010000:3.0:1788863879.040165:0:15722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb3c expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863879.040401:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324037888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863879.040437:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863879.040476:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863879.040775:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324037888 00000100:00100000:2.0:1788863879.040786:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324037888 00000100:00100000:2.0:1788863879.040908:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788863879.040924:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15722:x1875759324037888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788863879.041141:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15722:x1875759324037888:12345-0@lo:501:mount.lustre.0 Request processed in 223us (703us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788863879.041149:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788863879.041365:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324037888:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788863879.041380:0:15722:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788863879.041520:0:15722:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788863879.041527:0:15722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb3c expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.041537:0:15722:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16a00/0x744cd7666bbbbb35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbb3c expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863879.041562:0:15722:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8bf5bc0800 10000000:01000000:3.0:1788863879.041568:0:15722:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788863879.041574:0:15722:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788863879.041577:0:15722:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788863879.041582:0:15722:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788863879.041585:0:15722:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788863879.041611:0:15722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17000/0x744cd7666bbbbd96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.041619:0:15722:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17000/0x744cd7666bbbbd96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.041628:0:15722:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17000/0x744cd7666bbbbd96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863879.041656:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788863879.041684:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863879.041728:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863879.041957:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324038016 00000100:00100000:2.0:1788863879.041963:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324038016 00000100:00100000:2.0:1788863879.042037:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788863879.042045:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+16:15722:x1875759324038016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863879.042054:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863879.042066:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbbd9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbd96 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863879.042086:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbbd9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbd96 expref: 17 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863879.042095:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bee555600/0x744cd7666bbbbd9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbd96 expref: 17 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863879.042104:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555600, rc 0) 00000100:00100000:2.0:1788863879.042139:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+17:15722:x1875759324038016:12345-0@lo:101:mount.lustre.0 Request processed in 95us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863879.042146:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788863879.042208:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788863879.042220:0:15722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17000/0x744cd7666bbbbd96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbd9d expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.042229:0:15722:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17000/0x744cd7666bbbbd96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbd9d expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788863879.042967:0:15722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788863879.043934:0:15722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788863879.044254:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788863879.044299:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788863879.044336:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788863879.044386:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788863879.044422:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788863879.045485:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788863879.045639:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788863879.045652:0:15722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788863879.046950:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863879.047031:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863879.047082:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788863879.047160:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324038144 00000100:00100000:0.0:1788863879.047222:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324038144 00000100:00100000:0.0:1788863879.047284:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788863879.047294:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+17:15722:x1875759324038144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863879.047717:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+17:15722:x1875759324038144:12345-0@lo:501:mount.lustre.0 Request processed in 424us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863879.047735:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788863879.048993:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863879.049069:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788863879.049177:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863879.049225:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bffc2f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788863879.049337:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324038272 00000100:00100000:2.0:1788863879.049349:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324038272 00000100:00100000:2.0:1788863879.049396:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788863879.049404:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+17:15722:x1875759324038272:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788863879.050015:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+17:15722:x1875759324038272:12345-0@lo:503:mount.lustre.0 Request processed in 610us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863879.050022:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788863879.050415:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038272:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788863879.051714:0:15722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788863879.051951:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863879.052035:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863879.052148:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd0ff2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788863879.052464:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324038400 00000100:00100000:2.0:1788863879.052472:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324038400 00000100:00100000:2.0:1788863879.052557:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788863879.052568:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+17:15722:x1875759324038400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863879.052810:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+17:15722:x1875759324038400:12345-0@lo:502:mount.lustre.0 Request processed in 243us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863879.052817:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788863879.052929:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863879.053347:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788863879.053397:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788863879.053430:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788863879.053478:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788863879.053514:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788863879.053546:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788863879.053593:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788863879.053628:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788863879.053677:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788863879.053711:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863879.053765:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863879.054013:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd0ff2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788863879.054100:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324038528 00000100:00100000:0.0:1788863879.054107:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324038528 00000100:00100000:0.0:1788863879.054145:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788863879.054153:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcaaf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+17:15722:x1875759324038528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863879.054424:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcaaf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+17:15722:x1875759324038528:12345-0@lo:502:mount.lustre.0 Request processed in 270us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863879.054432:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788863879.054533:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863879.054604:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788863879.054615:0:15722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788863879.055683:0:15723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788863879.055693:0:15723:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788863879.055699:0:15723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863879.055702:0:15723:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788863879.055708:0:15723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788863879.055791:0:15723:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e8ac1f48000) 00000020:00000080:1.0:1788863879.055814:0:15723:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788863879.055831:0:15723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788863879.055919:0:15723:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8bf5bc0800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788863879.055927:0:15723:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788863879.055934:0:15723:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x744cd7666bbbbdab 00010000:00010000:1.0:1788863879.064042:0:15723:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788863879.064665:0:15723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788863879.068404:0:15723:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788863879.086814:0:15723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788863879.086880:0:15723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863879.086888:0:15723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863879.086890:0:15723:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788863879.086894:0:15723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863879.086898:0:15723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863879.086900:0:15723:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788863879.086902:0:15723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788863879.086904:0:15723:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788863879.086906:0:15723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863879.086908:0:15723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863879.086909:0:15723:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788863879.086912:0:15723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788863879.086914:0:15723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863879.086915:0:15723:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788863879.086919:0:15723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788863879.087009:0:15723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788863879.087014:0:15723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788863879.087015:0:15723:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788863879.087019:0:15723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788863879.087535:0:15722:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788863879.087584:0:15722:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788863879.087630:0:15722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17000/0x744cd7666bbbbd96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbd9d expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863879.087648:0:15722:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bffc17000/0x744cd7666bbbbd96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbd9d expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863879.087658:0:15722:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bf5bc0800 from 1 10000000:01000000:0.0:1788863879.087662:0:15722:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863879.087715:0:15722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863879.087728:0:15722:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863879.087759:0:15722:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863879.087799:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788863879.087944:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863879.088013:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324038656 00000100:00100000:0.0:1788863879.088021:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324038656 00000100:00100000:0.0:1788863879.088086:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788863879.088102:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcaaf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+17:15722:x1875759324038656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863879.088124:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863879.088145:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bfe994600/0x744cd7666bbbbdb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbdb2 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863879.088299:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bfe994600/0x744cd7666bbbbdb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbdb2 expref: 18 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863879.088320:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bfe994600/0x744cd7666bbbbdb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbdb2 expref: 18 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863879.088334:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfe994600, rc 0) 00000100:00100000:0.0:1788863879.088403:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcaaf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+18:15722:x1875759324038656:12345-0@lo:101:mount.lustre.0 Request processed in 302us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863879.088414:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788863879.088494:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc77a7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863879.088534:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863879.088557:0:15722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbdb9 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863879.088591:0:15722:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbdb9 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788863879.096638:0:15722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788863879.098477:0:15722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863879.098916:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788863879.098963:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788863879.099045:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788863879.099058:0:15722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788863879.099170:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863879.099246:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863879.099298:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bcb020cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863879.099650:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324038784 00000100:00100000:3.0:1788863879.099663:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324038784 00000100:00100000:3.0:1788863879.099760:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788863879.099776:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8c0174b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+18:15722:x1875759324038784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788863879.100103:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8c0174b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+18:15722:x1875759324038784:12345-0@lo:501:mount.lustre.0 Request processed in 326us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863879.100115:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788863879.101365:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788863879.101461:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038912:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788863879.101537:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863879.101577:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd0ff2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863879.101626:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324038912 00000100:00100000:2.0:1788863879.101633:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324038912 00000100:00100000:2.0:1788863879.101682:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788863879.101691:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee37b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+18:15722:x1875759324038912:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788863879.104372:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee37b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+18:15722:x1875759324038912:12345-0@lo:503:mount.lustre.0 Request processed in 2673us (2825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863879.104387:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788863879.107302:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324038912:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788863879.108071:0:15722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788863879.108155:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863879.108355:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863879.108413:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd0ff2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788863879.109862:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324039040 00000100:00100000:0.0:1788863879.109874:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324039040 00000100:00100000:0.0:1788863879.109922:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788863879.109930:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee37ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+18:15722:x1875759324039040:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863879.110157:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee37ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+18:15722:x1875759324039040:12345-0@lo:502:mount.lustre.0 Request processed in 226us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863879.110164:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788863879.111848:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863879.112540:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788863879.112650:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788863879.113429:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788863879.113477:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788863879.113512:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788863879.113557:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788863879.113595:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788863879.113632:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788863879.113681:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039168:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863879.114258:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863879.114298:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd0ff2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863879.114496:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324039168 00000100:00100000:2.0:1788863879.114504:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324039168 00000100:00100000:2.0:1788863879.114557:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788863879.114566:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee37b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+18:15722:x1875759324039168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863879.114785:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee37b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+18:15722:x1875759324039168:12345-0@lo:502:mount.lustre.0 Request processed in 219us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863879.114801:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788863879.117364:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039168:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788863879.117546:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788863879.117561:0:15722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788863879.120046:0:15727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863879.120057:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863879.120060:0:15727:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788863879.120068:0:15727:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8bf5bc0800 00000020:00000080:2.0:1788863879.120071:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788863879.120078:0:15727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863879.120080:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863879.120081:0:15727:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788863879.120083:0:15727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863879.120085:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863879.120087:0:15727:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788863879.120090:0:15727:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8bf5bc0800 00000020:00000080:2.0:1788863879.120092:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788863879.120148:0:15727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863879.120151:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863879.120153:0:15727:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788863879.120155:0:15727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788863879.120157:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863879.120159:0:15727:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788863879.120162:0:15727:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8bf5bc0800 00000020:00000080:2.0:1788863879.120164:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788863879.120201:0:15727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788863879.120204:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788863879.120206:0:15727:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788863879.120209:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788863879.120401:0:15722:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788863879.120425:0:15722:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863879.120445:0:15722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbdb9 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863879.120458:0:15722:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbdb9 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863879.120517:0:15722:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788863879.120520:0:15722:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8bf5bc0800 10000000:01000000:0.0:1788863879.120523:0:15722:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8bf5bc0800 10000000:01000000:0.0:1788863879.120527:0:15722:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788863879.120531:0:15722:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e8bf5bc0800 from 1 10000000:01000000:0.0:1788863879.120534:0:15722:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788863879.120568:0:15722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bfe995e00/0x744cd7666bbbbdc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863879.120577:0:15722:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bfe995e00/0x744cd7666bbbbdc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863879.120587:0:15722:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bfe995e00/0x744cd7666bbbbdc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863879.120607:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039296:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788863879.120663:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863879.120693:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc77a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788863879.120794:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324039296 00000100:00100000:2.0:1788863879.120801:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324039296 00000100:00100000:2.0:1788863879.120873:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788863879.120883:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee37bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+18:15722:x1875759324039296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788863879.120898:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863879.120917:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bee555a00/0x744cd7666bbbbdc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbdc0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863879.120940:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bee555a00/0x744cd7666bbbbdc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbdc0 expref: 19 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863879.120950:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bee555a00/0x744cd7666bbbbdc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbdc0 expref: 19 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863879.120958:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555a00, rc 0) 00000100:00100000:2.0:1788863879.120995:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee37bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+19:15722:x1875759324039296:12345-0@lo:101:mount.lustre.0 Request processed in 114us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863879.121002:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788863879.122325:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788863879.122345:0:15722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bfe995e00/0x744cd7666bbbbdc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbdc7 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863879.122356:0:15722:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bfe995e00/0x744cd7666bbbbdc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbdc7 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788863879.125484:0:15722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788863879.126039:0:15722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863879.126329:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788863879.126389:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788863879.126457:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788863879.126539:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788863879.126576:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788863879.126669:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788863879.126712:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788863879.126776:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788863879.126891:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788863879.126960:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788863879.127015:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788863879.127090:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788863879.127139:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788863879.127174:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788863879.127219:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788863879.127254:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788863879.127287:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788863879.127332:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788863879.127396:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788863879.132898:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788863879.133086:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788863879.133137:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788863879.133170:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788863879.133239:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788863879.133276:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788863879.133310:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788863879.133369:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788863879.133406:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788863879.133437:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788863879.133484:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788863879.133518:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788863879.133550:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788863879.133583:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788863879.133626:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788863879.133667:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788863879.133710:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788863879.133745:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788863879.133866:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788863879.133874:0:15722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788863879.133977:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863879.134045:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863879.134105:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324039424 00000100:00100000:0.0:1788863879.134112:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324039424 00000100:00100000:0.0:1788863879.134161:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788863879.134171:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:15722:x1875759324039424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863879.134382:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:15722:x1875759324039424:12345-0@lo:501:mount.lustre.0 Request processed in 213us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863879.134391:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788863879.134436:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc77a7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863879.134466:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788863879.134519:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039552:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863879.134571:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863879.134593:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324039552 00000100:00100000:0.0:1788863879.134597:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324039552 00000100:00100000:0.0:1788863879.134617:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788863879.134624:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+19:15722:x1875759324039552:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788863879.134749:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+19:15722:x1875759324039552:12345-0@lo:503:mount.lustre.0 Request processed in 124us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863879.134756:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788863879.134783:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc77a7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863879.134794:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039552:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788863879.135298:0:15722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788863879.135359:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863879.135394:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863879.135424:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd4c06000 going to sleep for 11 seconds 00000100:00100000:2.0:1788863879.139527:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324039680 00000100:00100000:2.0:1788863879.139542:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324039680 00000100:00100000:2.0:1788863879.139640:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788863879.139655:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee37a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+19:15722:x1875759324039680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788863879.140044:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee37a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+19:15722:x1875759324039680:12345-0@lo:502:mount.lustre.0 Request processed in 393us (4647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863879.140052:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788863879.145658:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788863879.146011:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788863879.146076:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788863879.146107:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788863879.146153:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788863879.146189:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788863879.146239:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788863879.146275:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788863879.146309:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788863879.146390:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788863879.146460:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788863879.146528:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788863879.146577:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788863879.146613:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788863879.146646:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788863879.146708:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788863879.146744:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788863879.146776:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788863879.146838:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788863879.146898:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788863879.146932:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788863879.146994:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788863879.147030:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788863879.147062:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788863879.147106:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788863879.147140:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788863879.147187:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788863879.147235:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788863879.147271:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788863879.147304:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788863879.147348:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788863879.147430:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788863879.147505:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788863879.147553:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788863879.147601:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788863879.147636:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788863879.147683:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788863879.147719:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788863879.147753:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788863879.147801:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788863879.147881:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788863879.159346:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788863879.159439:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863879.159492:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd4c06000 going to sleep for 11 seconds 00000100:00100000:1.0:1788863879.160014:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324039808 00000100:00100000:1.0:1788863879.160024:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324039808 00000100:00100000:1.0:1788863879.160091:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788863879.160102:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:15722:x1875759324039808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788863879.164639:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:15722:x1875759324039808:12345-0@lo:502:mount.lustre.0 Request processed in 4528us (5189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863879.164655:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788863879.168245:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324039808:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788863879.169443:0:15722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788863879.169474:0:15722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788863879.173217:0:15732:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788863879.173235:0:15732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e8bee48cd40) 00000020:00000080:3.0:1788863879.173258:0:15732:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788863879.173333:0:15732:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8bf5bc0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788863879.173337:0:15732:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8bf5bc0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788863879.173340:0:15732:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e8bf5bc0800 3 00010000:00080000:3.0:1788863879.173382:0:15732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8ac1f45800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1788863879.179509:0:15732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788863879.180510:0:15732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788863879.180553:0:15732:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788863879.180565:0:15732:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x744cd7666bbbbdd5 00000100:00080000:3.0:1788863879.180575:0:15732:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788863879.180587:0:15732:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e8ac1f45800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788863879.180639:0:15732:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bffcfea00 x1875759324039936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788863879.180691:0:15732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788863879.181145:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875759324039936:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788863879.181224:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863879.181283:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324039936 00000100:00100000:0.0:1788863879.181290:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324039936 00000100:00100000:0.0:1788863879.181326:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788863879.181333:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1875759324039936:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788863879.181441:0:14319:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:0.0:1788863879.181474:0:14319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x744cd7666bbbbddc 00000004:00100000:0.0:1788863879.181502:0:14319:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788863879.181534:0:14319:0:(import.c:65:import_set_state_nolock()) ffff8e8ac1115000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788863879.181584:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875759324039936:12345-0@lo:38:llog_process_th.0 Request processed in 250us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863879.181593:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788863879.181632:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bffcfea00 x1875759324039936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788863889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863879.181643:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788863879.181654:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788863879.181660:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788863879.181665:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788863879.181667:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8ac1f45800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788863879.181673:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875759324039936:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788863879.181926:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:2.0:1788863879.182193:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788863879.182198:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788863879.182201:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e8bff0c5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788863879.182206:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:2.0:1788863879.182209:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788863879.182216:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8bff0c5800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788863879.182234:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bca961180 x1875759324040192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788863879.182449:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324040320:0@lo:400:kworker.0 00000100:00100000:2.0:1788863879.182487:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863879.182513:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863879.182519:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324040064:0@lo:400:kworker.0 00000100:00100000:2.0:1788863879.182542:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863879.182565:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324040192:0@lo:8:kworker.0 00000100:00100000:2.0:1788863879.182586:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863879.182908:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324040448:0@lo:400:kworker.0 00000100:00100000:2.0:1788863879.182935:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863879.182974:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324040320 00000100:00100000:2.0:1788863879.182979:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324040320 00000100:00100000:2.0:1788863879.183011:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324040448 00000100:00100000:2.0:1788863879.183013:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324040448 00000100:00100000:2.0:1788863879.183037:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863879.183044:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324040320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863879.183081:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324040320:12345-0@lo:400:kworker.0 Request processed in 37us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863879.183089:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788863879.183103:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788863879.183109:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759324040448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863879.184526:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875759324040448:12345-0@lo:400:kworker.0 Request processed in 1412us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863879.184537:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788863879.184577:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324040064 00000100:00100000:2.0:1788863879.184584:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324040064 00000100:00100000:2.0:1788863879.184639:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324040192 00000100:00100000:2.0:1788863879.184643:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324040192 00000100:00100000:2.0:1788863879.184655:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863879.184662:0:15003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324040064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863879.184696:0:15003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324040064:12345-0@lo:400:kworker.0 Request processed in 35us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863879.184702:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863879.184713:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788863879.184717:0:15003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875759324040192:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788863879.184764:0:15003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875759324040192:12345-0@lo:8:kworker.0 Request processed in 45us (2176us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788863879.184769:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788863879.184796:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863879.184801:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863879.184838:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788863879.184846:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff0c5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863879.184867:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788863879.184871:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324040192:0@lo:8:kworker.0 00000100:00100000:2.0:1788863879.184907:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324040064:0@lo:400:kworker.0 00010000:00080000:2.0:1788863879.184921:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bca962d80 x1875759324040320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863879.184931:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324040320:0@lo:400:kworker.0 00000020:01000000:1.0:1788863879.189536:0:15722:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788863879.189576:0:15722:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788863879.189603:0:15722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bfe995e00/0x744cd7666bbbbdc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbdc7 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863879.189620:0:15722:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bfe995e00/0x744cd7666bbbbdc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbdc7 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788863879.189716:0:15722:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788863879.189719:0:15722:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788863879.189720:0:15722:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863879.189722:0:15722:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863879.189723:0:15722:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863879.189725:0:15722:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863879.189726:0:15722:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863879.189728:0:15722:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863879.189729:0:15722:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788863879.189733:0:15722:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788863879.189735:0:15722:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788863879.189736:0:15722:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788863879.189737:0:15722:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863879.189738:0:15722:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863879.189739:0:15722:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863879.189740:0:15722:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863879.189741:0:15722:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863879.189743:0:15722:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863879.189744:0:15722:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788863879.189770:0:15722:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788863879.189790:0:15722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324040576:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788863879.189903:0:15722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863879.189973:0:15722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc8a30180 going to sleep for 11 seconds 00000100:00100000:0.0:1788863879.191324:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324040576 00000100:00100000:0.0:1788863879.191335:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324040576 00000100:00100000:0.0:1788863879.191382:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788863879.191391:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+19:15722:x1875759324040576:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788863879.191420:0:14313:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788863879.191438:0:14313:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788863879.196883:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8bca963100 x1875759324040448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863879.196902:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875759324040448:0@lo:400:kworker.0 20000000:01000000:3.0:1788863879.268276:0:14313:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788863879.268304:0:14313:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788863879.268356:0:14334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788863879.268361:0:14334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788863879.268387:0:14334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863879.268406:0:14334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bff18b800/0x744cd7666bbbbcb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbcaf expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863879.268415:0:14334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863879.268482:0:14334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bff18b800/0x744cd7666bbbbcb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbbcaf expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863879.268501:0:14334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bff18b800/0x744cd7666bbbbcb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbbcaf expref: 19 pid: 14311 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863879.268517:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8514700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14334:1875759324040704:0@lo:104: 00000100:00100000:1.0:1788863879.268600:0:14334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863879.268660:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc8a30f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788863879.269562:0:14302:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324040704 00000100:00100000:3.0:1788863879.269577:0:14302:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324040704 00000100:00100000:3.0:1788863879.269666:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788863879.269681:0:14302:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+3:14334:x1875759324040704:12345-0@lo:104: 00010000:00010000:3.0:1788863879.269701:0:14302:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbcb6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.269831:0:14302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788863879.269900:0:14302:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+3:14334:x1875759324040704:12345-0@lo:104: Request processed in 174us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863879.269911:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788863879.269945:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863879.269955:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbcb6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.269964:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16000 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863879.269970:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbbcb6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.269982:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbbcb6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863879.269991:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbbcb6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863879.269998:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788863879.270037:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbcb6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270062:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863879.270100:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbcb6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270110:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bffc16000/0x744cd7666bbbbcaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbcb6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270147:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863879.270150:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863879.270152:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863879.270181:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324040832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863879.270228:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863879.270276:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324040832 00000100:00100000:3.0:1788863879.270280:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324040832 00010000:00010000:3.0:1788863879.270296:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bff18b800/0x744cd7666bbbbcb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbcaf expref: 20 pid: 14311 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863879.270318:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788863879.270324:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+20:3307:x1875759324040832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863879.270334:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863879.270339:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bff18b800/0x744cd7666bbbbcb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbcaf expref: 20 pid: 14311 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270350:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bff18b800/0x744cd7666bbbbcb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbbcaf expref: 20 pid: 14311 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270367:0:14304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270385:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788863879.270399:0:14304:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006469820s 00010000:00010000:3.0:1788863879.270403:0:14304:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270410:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270417:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270423:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270428:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ae00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863879.270432:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270440:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270449:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270458:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863879.270495:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+20:3307:x1875759324040832:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863879.270502:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788863879.270573:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bff18b800/0x744cd7666bbbbcb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbbcaf expref: 19 pid: 14311 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863879.270590:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14334:1875759324040704:0@lo:104: 00010000:00010000:3.0:1788863879.270618:0:14334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270630:0:14334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270638:0:14334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863879.270646:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbde3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863879.270810:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324040832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863879.301481:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+18:15722:x1875759324040576:12345-0@lo:253:mount.lustre.0 Request processed in 110074us (111564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863879.301508:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788863879.301887:0:15722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8514e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98ce9f4a-6069-439b-828d-fac2605e9de4:15722:1875759324040576:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788863879.301911:0:15722:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788863879.301916:0:15722:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788863879.301919:0:15722:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788863879.301920:0:15722:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788863879.301922:0:15722:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788863879.301924:0:15722:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788863879.301926:0:15722:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788863879.301928:0:15722:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788863879.301931:0:15722:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788863879.301933:0:15722:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788863879.301957:0:15722:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788863879.318917:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788863879.321034:0:15722:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788863879.321583:0:15722:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788863879.321746:0:15722:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788863879.322057:0:15722:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788863879.322657:0:15722:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788863879.323224:0:15722:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788863879.326649:0:15722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788863879.420755:0:15722:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788863879.420775:0:15722:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788863879.420929:0:15722:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788863879.421025:0:15722:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788863879.421044:0:15722:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788863879.421094:0:15722:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1788863880.278218:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324040960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863880.278328:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863880.278495:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324040960 00000100:00100000:0.0:1788863880.278506:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324040960 00000100:00100000:0.0:1788863880.278673:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788863880.278685:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324040960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863880.278733:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863880.279007:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324040960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 324us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863880.279015:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863880.279139:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324040960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788863880.348887:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788863880.728908:0:14316:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788863880.728920:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e8bfb3af800 from 8 10000000:01000000:1.0:1788863880.728963:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788863880.729034:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b000/0x744cd7666bbbbdea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863880.729047:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b000/0x744cd7666bbbbdea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863880.729061:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b000/0x744cd7666bbbbdea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863880.729093:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324041088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788863880.729399:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863880.729708:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc7faa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863880.730441:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324041088 00000100:00100000:3.0:1788863880.730452:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324041088 00000100:00100000:3.0:1788863880.730707:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788863880.730719:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+18:14316:x1875759324041088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863880.730737:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863880.730762:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bffc16000/0x744cd7666bbbbdf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbdea expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863880.730808:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc16000/0x744cd7666bbbbdf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbdea expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863880.730844:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bffc16000/0x744cd7666bbbbdf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbdea expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863880.730876:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16000, rc 0) 00000100:00100000:3.0:1788863880.733024:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:14316:x1875759324041088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2299us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863880.733037:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788863880.733685:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324041088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863880.733715:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b000/0x744cd7666bbbbdea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbdf1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863880.733730:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b000/0x744cd7666bbbbdea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbdf1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863880.733840:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324041216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788863880.734123:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863880.734323:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc7faa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788863880.734443:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324041216 00000100:00100000:3.0:1788863880.734451:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324041216 00000100:00100000:3.0:1788863880.734748:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788863880.734760:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+19:14316:x1875759324041216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788863880.734781:0:14313:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788863880.734810:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788863880.734813:0:14313:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788863880.734978:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+19:14316:x1875759324041216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 220us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863880.734986:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788863880.735424:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324041216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788863880.735514:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788863880.735531:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b000/0x744cd7666bbbbdea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbdf1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863880.735544:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7b000/0x744cd7666bbbbdea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbdf1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863881.367568:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863882.391682:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863883.414002:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788863884.379740:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788863884.379748:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788863884.379753:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e8bff0c5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863884.379777:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8bff0c5800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788863884.379807:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8bcabdca80 x1875759324041600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863884.379910:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324041856:0@lo:400:kworker.0 00000100:00100000:0.0:1788863884.380016:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863884.380025:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98ce9f4a-6069-439b-828d-fac2605e9de4:3309:1875759324041344:0@lo:400:kworker.0 00000100:00100000:1.0:1788863884.380085:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863884.380125:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759324041984:0@lo:400:kworker.0 00000100:00100000:0.0:1788863884.380128:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324041472:0@lo:400:kworker.0 00000100:00100000:0.0:1788863884.380168:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863884.380180:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863884.380212:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863884.380218:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759324041728:0@lo:400:kworker.0 00000100:00100000:2.0:1788863884.382223:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324041472 00000100:00100000:2.0:1788863884.382245:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324041472 00000100:00100000:2.0:1788863884.382329:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788863884.382341:0:15003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324041472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863884.383406:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324041344 00000100:00100000:1.0:1788863884.383421:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324041344 00000100:00100000:1.0:1788863884.383473:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788863884.383484:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:3309:x1875759324041344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863884.383590:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:3309:x1875759324041344:12345-0@lo:400:kworker.0 Request processed in 107us (3504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863884.383599:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788863884.383681:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324041856 00000100:00100000:1.0:1788863884.383687:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324041856 00000100:00100000:1.0:1788863884.383738:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324041984 00000100:00100000:1.0:1788863884.383742:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324041984 00000100:00100000:0.0:1788863884.387452:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863884.390030:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324041728 00000100:00100000:1.0:1788863884.390055:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324041728 00000100:00100000:1.0:1788863884.392304:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788863884.392324:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324041856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863884.392518:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324041856:12345-0@lo:400:kworker.0 Request processed in 199us (12501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863884.392527:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788863884.392552:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863884.392560:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759324041984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863884.392609:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759324041984:12345-0@lo:400:kworker.0 Request processed in 50us (12427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863884.392615:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788863884.392618:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bcabdea00 x1875759324041856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863884.392627:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788863884.392633:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759324041728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863884.392639:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324041856:0@lo:400:kworker.0 00000100:00100000:1.0:1788863884.396999:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98ce9f4a-6069-439b-828d-fac2605e9de4:3309:1875759324041344:0@lo:400:kworker.0 00010000:00080000:1.0:1788863884.397068:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bcabdf480 x1875759324041984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863884.397085:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759324041984:0@lo:400:kworker.0 00000100:00100000:1.0:1788863884.397502:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759324041728:12345-0@lo:400:kworker.0 Request processed in 4864us (10061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863884.397516:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788863884.398283:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bcabdc000 x1875759324041728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863884.398303:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759324041728:0@lo:400:kworker.0 00000100:00100000:2.0:1788863884.405187:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324041600:0@lo:8:kworker.0 00000100:00100000:2.0:1788863884.405296:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788863884.405437:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863884.405446:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863884.405464:0:15006:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788863884.405475:0:15006:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788863884.406312:0:15003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324041472:12345-0@lo:400:kworker.0 Request processed in 23964us (26132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863884.406330:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788863884.406640:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324041600 00000100:00100000:1.0:1788863884.406658:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324041600 00000100:00100000:2.0:1788863884.406669:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324041472:0@lo:400:kworker.0 00000100:00100000:1.0:1788863884.406696:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863884.406708:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875759324041600:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788863884.406775:0:15005:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1788863884.406820:0:15005:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x744cd7666bbbbdf8 00002000:00100000:1.0:1788863884.406844:0:15005:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e8ac19c1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788863884.406876:0:15005:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788863884.406881:0:15005:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788863884.411830:0:15005:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788863884.411917:0:15005:0:(import.c:65:import_set_state_nolock()) ffff8e8ac19c1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863884.412300:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875759324041600:12345-0@lo:8:kworker.0 Request processed in 5590us (7000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863884.412314:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788863884.412370:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bcabdca80 x1875759324041600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788863909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788863884.412498:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788863884.412518:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788863884.412527:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788863884.412531:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e8bff0c5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788863884.412631:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788863884.412662:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875759324041600:0@lo:8:kworker.0 00000004:00080000:1.0:1788863884.413256:0:14343:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788863884.413281:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14343:1875759324042240:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788863884.415373:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863884.415405:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324042112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863884.415503:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863884.415912:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863884.415934:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc7faa600 going to sleep for 11 seconds 00000100:00100000:1.0:1788863884.416077:0:15908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324042240 00000100:00100000:1.0:1788863884.416089:0:15908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324042240 00000100:00100000:1.0:1788863884.416169:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863884.416181:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14343:x1875759324042240:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788863884.416467:0:14342:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:2.0:1788863884.416800:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788863884.417466:0:14342:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 513546611687ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788863884.421459:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324042112 00000100:00100000:3.0:1788863884.421552:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324042112 00000100:00100000:3.0:1788863884.421765:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788863884.421779:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875759324042112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863884.421845:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863884.422011:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875759324042112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 234us (6507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863884.422020:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788863884.428445:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bc8516a00 x1875759324042112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788863900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863884.428505:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324042112:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1788863884.453742:0:15005:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788863884.453762:0:15005:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788863884.453769:0:15005:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00010000:00010000:2.0:1788863884.456601:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863884.460752:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863884.460777:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbdff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.460807:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=513s v=(0 0) 00010000:00010000:1.0:1788863884.460813:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863884.460823:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbdff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.460848:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbdff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.460891:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbdff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.460901:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbdff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.460943:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.460968:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.460978:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbdff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.460987:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.460994:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbdff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.461006:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbdff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.461489:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbdff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.461502:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbdff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.461530:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.461533:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.461536:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863884.462543:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863884.462558:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.462576:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=513s v=(0 0) 00010000:00010000:1.0:1788863884.462589:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863884.462597:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.462614:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.462626:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.462635:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.462660:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.462674:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.462682:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.462692:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.462698:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.462709:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.462740:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.462762:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.462781:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.462783:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.462785:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863884.463593:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863884.463604:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e68c5d99/0x744cd7666bbbbe0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.463618:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=513s v=(0 0) 00010000:00010000:1.0:1788863884.463623:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863884.463627:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e68c5d99/0x744cd7666bbbbe0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.463639:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e68c5d99/0x744cd7666bbbbe0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.463648:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e68c5d99/0x744cd7666bbbbe0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.463656:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e68c5d99/0x744cd7666bbbbe0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.463733:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863884.464584:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863884.464602:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e68c5d99/0x744cd7666bbbbe0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.464616:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ae00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863884.464622:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e68c5d99/0x744cd7666bbbbe0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.464635:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e68c5d99/0x744cd7666bbbbe0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.464666:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e68c5d99/0x744cd7666bbbbe0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.464674:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e68c5d99/0x744cd7666bbbbe0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.464702:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863884.464704:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863884.464706:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863884.465294:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863884.465313:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.465329:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=513s v=(0 0) 00010000:00010000:1.0:1788863884.465334:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863884.465341:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.466205:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.466225:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.466235:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.466264:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.466288:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.466295:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.466306:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a600 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.466313:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.466323:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.467472:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.467502:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.468517:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.468523:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.468527:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863884.469406:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863884.469420:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d426033/0x744cd7666bbbbe1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.469441:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=513s v=(0 0) 00010000:00010000:1.0:1788863884.469447:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863884.469456:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d426033/0x744cd7666bbbbe1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.469476:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d426033/0x744cd7666bbbbe1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.469489:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d426033/0x744cd7666bbbbe1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.469499:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d426033/0x744cd7666bbbbe1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.469538:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.469552:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.469559:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d426033/0x744cd7666bbbbe1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.469582:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.469589:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d426033/0x744cd7666bbbbe1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.469599:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d426033/0x744cd7666bbbbe1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.469621:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d426033/0x744cd7666bbbbe1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.469629:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d426033/0x744cd7666bbbbe1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.469647:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.469649:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.469650:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863884.470125:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863884.470132:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0990b2f/0x744cd7666bbbbe22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470143:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=513s v=(0 0) 00010000:00010000:1.0:1788863884.470153:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863884.470158:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0990b2f/0x744cd7666bbbbe22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470169:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0990b2f/0x744cd7666bbbbe22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470179:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0990b2f/0x744cd7666bbbbe22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470186:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0990b2f/0x744cd7666bbbbe22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470202:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.470213:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.470218:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0990b2f/0x744cd7666bbbbe22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470226:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.470229:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0990b2f/0x744cd7666bbbbe22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470237:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0990b2f/0x744cd7666bbbbe22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470249:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0990b2f/0x744cd7666bbbbe22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470270:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0990b2f/0x744cd7666bbbbe22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470285:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.470288:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.470290:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863884.470760:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863884.470767:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470776:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=513s v=(0 0) 00010000:00010000:1.0:1788863884.470780:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863884.470784:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470794:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470802:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470809:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470827:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.470841:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.470876:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470884:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ba00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.470889:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470897:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470911:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470918:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.470934:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.470936:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.470937:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863884.473725:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863884.473747:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc6a754/0x744cd7666bbbbe30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.473771:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=513s v=(0 0) 00010000:00010000:1.0:1788863884.473776:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863884.473783:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abc6a754/0x744cd7666bbbbe30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.474280:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abc6a754/0x744cd7666bbbbe30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.474296:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc6a754/0x744cd7666bbbbe30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.474307:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abc6a754/0x744cd7666bbbbe30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.474329:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.474345:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.474432:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abc6a754/0x744cd7666bbbbe30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.474443:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7bc00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.474449:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc6a754/0x744cd7666bbbbe30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.474460:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc6a754/0x744cd7666bbbbe30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.474484:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abc6a754/0x744cd7666bbbbe30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.474493:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abc6a754/0x744cd7666bbbbe30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.474524:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.474526:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.474528:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863884.475509:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863884.475524:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.475542:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=513s v=(0 0) 00010000:00010000:1.0:1788863884.475547:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863884.475555:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.475574:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.475586:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.475594:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.475613:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.475625:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.475630:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.475654:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a600 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.475659:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.475670:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.475685:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.475694:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad4c2417/0x744cd7666bbbbe37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.475713:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.475726:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.475728:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863884.476679:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863884.476691:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.476707:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=513s v=(0 0) 00010000:00010000:1.0:1788863884.476712:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863884.476729:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.476744:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.476762:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.476771:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.476795:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.476908:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.476915:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.476925:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.476930:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.476942:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.476960:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.476969:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbbe3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.476991:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.476999:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.477002:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863884.478785:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863884.479109:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbe45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.479131:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=513s v=(0 0) 00010000:00010000:1.0:1788863884.479136:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863884.479144:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbe45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.479164:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbe45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.479176:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbe45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.479186:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbe45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.479213:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.479237:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.479244:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbe45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.479253:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.479258:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbe45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.479286:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbe45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.479306:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbe45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.479315:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbbe45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.479338:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.479340:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.479342:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788863884.487131:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788863884.487163:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.487193:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=513s v=(0 0) 00010000:00010000:1.0:1788863884.487200:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863884.487209:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.487232:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.487249:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.487273:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.487308:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.487338:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.487348:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.488449:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ba00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.488459:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.488474:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.488506:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.488516:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbbe4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.488561:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.488564:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.488569:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863884.494604:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.494786:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033435a81/0x744cd7666bbbbe53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.494942:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.495105:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.495116:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033435a81/0x744cd7666bbbbe53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.495170:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033435a81/0x744cd7666bbbbe53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.495182:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033435a81/0x744cd7666bbbbe53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.495191:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033435a81/0x744cd7666bbbbe53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.495220:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.495312:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.495360:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033435a81/0x744cd7666bbbbe53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.495376:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe994000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.495384:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033435a81/0x744cd7666bbbbe53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.495400:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033435a81/0x744cd7666bbbbe53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.495433:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033435a81/0x744cd7666bbbbe53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.495442:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033435a81/0x744cd7666bbbbe53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.495480:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.495482:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.495484:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863884.497192:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.497203:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000921ce528/0x744cd7666bbbbe5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.497235:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.497323:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.497334:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000921ce528/0x744cd7666bbbbe5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.497353:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000921ce528/0x744cd7666bbbbe5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.497364:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000921ce528/0x744cd7666bbbbe5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.497373:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000921ce528/0x744cd7666bbbbe5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.497401:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788863884.502402:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.502424:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc445a5a/0x744cd7666bbbbe61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.502451:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.502457:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.502466:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc445a5a/0x744cd7666bbbbe61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.502485:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc445a5a/0x744cd7666bbbbe61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.502512:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc445a5a/0x744cd7666bbbbe61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.502522:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc445a5a/0x744cd7666bbbbe61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.502562:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788863884.503117:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.503125:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf49cd1/0x744cd7666bbbbe68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.503137:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.503141:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.503147:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bf49cd1/0x744cd7666bbbbe68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.503160:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bf49cd1/0x744cd7666bbbbe68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.503170:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf49cd1/0x744cd7666bbbbe68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.503179:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bf49cd1/0x744cd7666bbbbe68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.503202:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788863884.503662:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.503670:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091327ddf/0x744cd7666bbbbe6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.503681:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.503685:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.503690:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091327ddf/0x744cd7666bbbbe6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.503701:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091327ddf/0x744cd7666bbbbe6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.503711:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091327ddf/0x744cd7666bbbbe6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.503732:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091327ddf/0x744cd7666bbbbe6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.503743:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788863884.504245:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.504252:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006514b190/0x744cd7666bbbbe76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.504261:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.504275:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.504280:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006514b190/0x744cd7666bbbbe76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.504291:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006514b190/0x744cd7666bbbbe76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.504301:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006514b190/0x744cd7666bbbbe76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.504309:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006514b190/0x744cd7666bbbbe76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.504318:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788863884.505360:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788863884.505378:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000921ce528/0x744cd7666bbbbe5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505404:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe995000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863884.505412:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000921ce528/0x744cd7666bbbbe5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505424:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000921ce528/0x744cd7666bbbbe5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505452:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000921ce528/0x744cd7666bbbbe5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505460:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000921ce528/0x744cd7666bbbbe5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505501:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788863884.505506:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc445a5a/0x744cd7666bbbbe61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505514:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe994400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863884.505517:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc445a5a/0x744cd7666bbbbe61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505524:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc445a5a/0x744cd7666bbbbe61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505535:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc445a5a/0x744cd7666bbbbe61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505549:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc445a5a/0x744cd7666bbbbe61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505563:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788863884.505568:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bf49cd1/0x744cd7666bbbbe68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505575:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe995600 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863884.505578:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf49cd1/0x744cd7666bbbbe68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505586:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf49cd1/0x744cd7666bbbbe68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505597:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bf49cd1/0x744cd7666bbbbe68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505605:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bf49cd1/0x744cd7666bbbbe68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505617:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863884.505622:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091327ddf/0x744cd7666bbbbe6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505630:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe995c00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863884.505639:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091327ddf/0x744cd7666bbbbe6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505660:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091327ddf/0x744cd7666bbbbe6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505673:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091327ddf/0x744cd7666bbbbe6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505680:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091327ddf/0x744cd7666bbbbe6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505693:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863884.505697:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006514b190/0x744cd7666bbbbe76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505703:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe994c00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863884.505706:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006514b190/0x744cd7666bbbbe76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505725:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006514b190/0x744cd7666bbbbe76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505736:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006514b190/0x744cd7666bbbbe76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505744:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006514b190/0x744cd7666bbbbe76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863884.505764:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863884.505767:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863884.505769:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.509914:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863884.511018:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.511034:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d893dfa/0x744cd7666bbbbe7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511057:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.511063:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.511070:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d893dfa/0x744cd7666bbbbe7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511088:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d893dfa/0x744cd7666bbbbe7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511101:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d893dfa/0x744cd7666bbbbe7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511116:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d893dfa/0x744cd7666bbbbe7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511134:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863884.511149:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863884.511156:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d893dfa/0x744cd7666bbbbe7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511164:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe995200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863884.511169:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d893dfa/0x744cd7666bbbbe7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511179:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d893dfa/0x744cd7666bbbbe7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511202:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d893dfa/0x744cd7666bbbbe7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511209:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d893dfa/0x744cd7666bbbbe7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511235:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863884.511238:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863884.511239:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863884.511825:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.511841:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbe84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511885:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.511890:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.511895:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbe84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511907:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbe84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511918:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbe84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511926:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbe84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.511945:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788863884.512382:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.512389:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000602bad0d/0x744cd7666bbbbe8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512398:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.512401:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.512406:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000602bad0d/0x744cd7666bbbbe8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512417:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000602bad0d/0x744cd7666bbbbe8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512432:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000602bad0d/0x744cd7666bbbbe8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512440:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000602bad0d/0x744cd7666bbbbe8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512457:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788863884.512472:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788863884.512478:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbe84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512485:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe995400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863884.512490:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbe84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512499:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbe84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512514:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbe84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512523:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5bd9c4d/0x744cd7666bbbbe84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512546:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863884.512556:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000602bad0d/0x744cd7666bbbbe8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512564:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe994800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863884.512567:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000602bad0d/0x744cd7666bbbbe8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512575:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000602bad0d/0x744cd7666bbbbe8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512585:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000602bad0d/0x744cd7666bbbbe8b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512592:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000602bad0d/0x744cd7666bbbbe8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.512606:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863884.512608:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863884.512609:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.513463:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863884.518610:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.518637:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003863eefc/0x744cd7666bbbbe92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.518668:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.518674:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.518682:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003863eefc/0x744cd7666bbbbe92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.518712:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003863eefc/0x744cd7666bbbbe92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.518738:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003863eefc/0x744cd7666bbbbe92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.518748:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003863eefc/0x744cd7666bbbbe92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.519253:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788863884.520277:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.520293:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b412f9b/0x744cd7666bbbbe99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.520312:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.520317:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.520324:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b412f9b/0x744cd7666bbbbe99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.520343:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b412f9b/0x744cd7666bbbbe99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.520368:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b412f9b/0x744cd7666bbbbe99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.520392:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b412f9b/0x744cd7666bbbbe99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.520702:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863884.520725:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003863eefc/0x744cd7666bbbbe92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.520735:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe994200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.520741:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003863eefc/0x744cd7666bbbbe92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.520769:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003863eefc/0x744cd7666bbbbe92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.520795:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003863eefc/0x744cd7666bbbbe92 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.520901:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003863eefc/0x744cd7666bbbbe92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.521067:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.521072:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b412f9b/0x744cd7666bbbbe99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.521080:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe994a00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.521084:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b412f9b/0x744cd7666bbbbe99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.521092:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b412f9b/0x744cd7666bbbbe99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.521105:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b412f9b/0x744cd7666bbbbe99 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.521113:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.521114:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.521123:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863884.521277:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788863884.521287:0:15005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b412f9b/0x744cd7666bbbbe99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788863884.522332:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.522344:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000463e05a/0x744cd7666bbbbea0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.522423:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.522429:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.522437:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000463e05a/0x744cd7666bbbbea0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.522458:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000463e05a/0x744cd7666bbbbea0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.522469:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000463e05a/0x744cd7666bbbbea0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.522477:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000463e05a/0x744cd7666bbbbea0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.523304:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.523318:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000463e05a/0x744cd7666bbbbea0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.523331:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe995a00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.523336:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000463e05a/0x744cd7666bbbbea0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.523346:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000463e05a/0x744cd7666bbbbea0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.523430:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000463e05a/0x744cd7666bbbbea0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.523488:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.523490:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.523492:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863884.523593:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788863884.523602:0:15005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000463e05a/0x744cd7666bbbbea0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.523898:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863884.525200:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.525212:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001913d33/0x744cd7666bbbbea7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.525231:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.525236:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.525243:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001913d33/0x744cd7666bbbbea7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.525261:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001913d33/0x744cd7666bbbbea7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.525271:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001913d33/0x744cd7666bbbbea7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.525280:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001913d33/0x744cd7666bbbbea7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.525344:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.526757:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.526777:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001913d33/0x744cd7666bbbbea7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.526804:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe995800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.526810:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001913d33/0x744cd7666bbbbea7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.526823:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001913d33/0x744cd7666bbbbea7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.526906:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001913d33/0x744cd7666bbbbea7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.526921:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001913d33/0x744cd7666bbbbea7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.526971:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.526974:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.526977:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863884.527642:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.527656:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024aabbef/0x744cd7666bbbbeae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.527685:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.527691:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.527700:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024aabbef/0x744cd7666bbbbeae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.527731:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024aabbef/0x744cd7666bbbbeae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.527743:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024aabbef/0x744cd7666bbbbeae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.527754:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024aabbef/0x744cd7666bbbbeae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.528120:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788863884.528424:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.528435:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024aabbef/0x744cd7666bbbbeae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.528448:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfeb65800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.528454:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024aabbef/0x744cd7666bbbbeae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.528466:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024aabbef/0x744cd7666bbbbeae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.528486:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024aabbef/0x744cd7666bbbbeae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.528494:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024aabbef/0x744cd7666bbbbeae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.528538:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.528541:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.528544:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788863884.529530:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788863884.529546:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbbeb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.529563:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=513s v=(0 0) 00010000:00010000:0.0:1788863884.529568:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863884.529574:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbbeb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.529590:0:15005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbbeb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.529616:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbbeb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.529626:0:15005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbbeb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863884.529704:0:15005:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788863884.530314:0:15005:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1788863884.530732:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14343:x1875759324042240:12345-0@lo:5:osp-pre-1-0.0 Request processed in 114530us (114799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863884.530752:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788863884.532259:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788863884.532276:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbbeb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.532295:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfeb65a00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863884.532301:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbbeb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.532316:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbbeb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.532348:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbbeb5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.532420:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbbeb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863884.532454:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.532456:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863884.532458:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863884.532517:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14343:1875759324042240:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788863884.532540:0:14343:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788863884.532620:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14343:1875759324042368:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788863884.532704:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863884.532781:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd8349240 going to sleep for 11 seconds 00000100:00100000:3.0:1788863884.534166:0:15006:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324042368 00000100:00100000:3.0:1788863884.534191:0:15006:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324042368 00000100:00100000:3.0:1788863884.534285:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788863884.534302:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14343:x1875759324042368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788863884.534398:0:15006:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788863884.544500:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14343:x1875759324042368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10191us (11783us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788863884.544519:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788863884.544727:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8515500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14343:1875759324042368:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788863884.544750:0:14343:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:2.0:1788863884.545252:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788863885.400605:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324042496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863885.400724:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863885.400834:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324042496 00000100:00100000:1.0:1788863885.400843:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324042496 00000100:00100000:1.0:1788863885.400922:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863885.400932:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324042496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863885.400977:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863885.401027:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324042496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863885.401035:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863885.401090:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324042496:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788863885.464054:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863886.486301:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863886.870885:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788863887.512213:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788863888.533608:0:16081:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788863888.534327:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863889.494714:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863889.494739:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324042624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863889.494820:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863889.494911:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324042624 00000100:00100000:2.0:1788863889.494920:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324042624 00000100:00100000:2.0:1788863889.494979:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788863889.494989:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875759324042624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863889.495024:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863889.495074:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875759324042624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863889.495081:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788863889.495105:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863889.495707:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324042624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863889.499888:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98ce9f4a-6069-439b-828d-fac2605e9de4:3309:1875759324042752:0@lo:400:kworker.0 00000100:00100000:1.0:1788863889.499961:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863889.500001:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759324043264:0@lo:400:kworker.0 00000100:00100000:1.0:1788863889.500029:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863889.500054:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863889.500059:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759324043136:0@lo:400:kworker.0 00000100:00100000:1.0:1788863889.500079:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863889.500101:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324042880:0@lo:400:kworker.0 00000100:00100000:1.0:1788863889.500139:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863889.500164:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788863889.500169:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759324043008:0@lo:400:kworker.0 00000100:00100000:1.0:1788863889.500186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863889.500334:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324042752 00000100:00100000:3.0:1788863889.500344:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324042752 00000100:00100000:3.0:1788863889.500394:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788863889.500403:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+19:3309:x1875759324042752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863889.500475:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+19:3309:x1875759324042752:12345-0@lo:400:kworker.0 Request processed in 73us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863889.500483:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788863889.511163:0:15908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324042880 00000100:00100000:0.0:1788863889.511179:0:15908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324042880 00000100:00100000:0.0:1788863889.511242:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788863889.511253:0:15908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324042880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863889.511342:0:15908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324042880:12345-0@lo:400:kworker.0 Request processed in 91us (11201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863889.511349:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788863889.511499:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863889.514925:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324043264 00000100:00100000:0.0:1788863889.514938:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324043264 00000100:00100000:0.0:1788863889.514994:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324043136 00000100:00100000:0.0:1788863889.514997:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324043136 00000100:00100000:0.0:1788863889.515010:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324043008 00000100:00100000:0.0:1788863889.515013:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324043008 00000100:00100000:0.0:1788863889.515029:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863889.515038:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759324043264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863889.515125:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875759324043264:12345-0@lo:400:kworker.0 Request processed in 88us (15094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863889.515133:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788863889.515148:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863889.515153:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759324043136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863889.515174:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875759324043136:12345-0@lo:400:kworker.0 Request processed in 21us (15094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863889.515179:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863889.515187:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863889.515192:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759324043008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863889.515212:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875759324043008:12345-0@lo:400:kworker.0 Request processed in 20us (15025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863889.515217:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788863889.515235:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788863889.520506:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff0bb480 x1875759324043136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863889.520526:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875759324043136:0@lo:400:kworker.0 00000100:00100000:1.0:1788863889.520540:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bc8516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98ce9f4a-6069-439b-828d-fac2605e9de4:3309:1875759324042752:0@lo:400:kworker.0 00010000:00080000:1.0:1788863889.520551:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff0bb800 x1875759324043264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863889.520560:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875759324043264:0@lo:400:kworker.0 00010000:00080000:1.0:1788863889.520604:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8bff0b8000 x1875759324043008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863889.520613:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875759324043008:0@lo:400:kworker.0 00000100:00100000:1.0:1788863889.520637:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324042880:0@lo:400:kworker.0 00010000:00010000:3.0:1788863889.568014:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788863889.669243:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788863889.669260:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:0.0:1788863890.524184:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863890.524208:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324043392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788863890.524291:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863890.524570:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324043392 00000100:00100000:3.0:1788863890.524579:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324043392 00000100:00100000:3.0:1788863890.524650:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788863890.524660:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324043392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863890.524705:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863890.524768:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324043392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863890.524775:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863890.524898:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324043392:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788863890.583529:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863891.571375:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863891.571665:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298880384 00000100:00100000:1.0:1788863891.571676:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298880384 00000100:00100000:1.0:1788863891.571724:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:1.0:1788863891.571733:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2349:x1875759298880384:12345-192.168.204.51@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788863891.571768:0:14312:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 757561f2-9678-4319-9860-6d7710ce5d8a@192.168.204.51@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:1.0:1788863891.571808:0:14312:0:(genops.c:1384:class_connect()) connect: client 757561f2-9678-4319-9860-6d7710ce5d8a, cookie 0x744cd7666bbbbebc 00000100:00080000:1.0:1788863891.572003:0:14312:0:(import.c:65:import_set_state_nolock()) ffff8e8ac19c3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863891.572069:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+5:2349:x1875759298880384:12345-192.168.204.51@tcp:250:mount.lustre.0 Request processed in 335us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.572096:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:3.0:1788863891.605161:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863891.605270:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298880512 00000100:00100000:1.0:1788863891.605281:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298880512 00000100:00100000:1.0:1788863891.605349:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:1.0:1788863891.605360:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+5:13725:x1875759298880512:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788863891.605377:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863891.605395:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7bc00/0x744cd7666bbbbec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33121a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863891.605424:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7bc00/0x744cd7666bbbbec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33121a expref: 6 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863891.605436:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7bc00/0x744cd7666bbbbec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33121a expref: 6 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863891.605457:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7bc00, rc 0) 00000100:00100000:1.0:1788863891.605514:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+6:13725:x1875759298880512:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 156us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.605522:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00010000:00010000:3.0:1788863891.607417:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863891.627799:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863891.627935:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298880640 00000100:00100000:3.0:1788863891.627945:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298880640 00000100:00100000:3.0:1788863891.628004:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:3.0:1788863891.628015:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+6:13725:x1875759298880640:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788863891.628402:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+6:13725:x1875759298880640:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 388us (613us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788863891.628412:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:3.0:1788863891.635971:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863891.637591:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298880768 00000100:00100000:2.0:1788863891.637605:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298880768 00000100:00100000:2.0:1788863891.637678:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:2.0:1788863891.637688:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+6:13725:x1875759298880768:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788863891.637723:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863891.637746:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bee555000/0x744cd7666bbbbeca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331221 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863891.637780:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bee555000/0x744cd7666bbbbeca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331221 expref: 7 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863891.637792:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bee555000/0x744cd7666bbbbeca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331221 expref: 7 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863891.637802:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555000, rc 0) 00000100:00100000:2.0:1788863891.637915:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+7:13725:x1875759298880768:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 227us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863891.637922:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:2.0:1788863891.642631:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863891.642761:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298880896 00000100:00100000:1.0:1788863891.642775:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298880896 00000100:00100000:1.0:1788863891.642844:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:1.0:1788863891.642898:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+7:13725:x1875759298880896:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788863891.643888:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+8:13725:x1875759298880896:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 988us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.643900:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:0.0:1788863891.647709:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863891.647838:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298881024 00000100:00100000:1.0:1788863891.647889:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298881024 00000100:00100000:1.0:1788863891.647970:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:1.0:1788863891.647982:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+8:13725:x1875759298881024:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788863891.648460:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+8:13725:x1875759298881024:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 479us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.648472:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:3.0:1788863891.657693:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863891.658432:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298881152 00000100:00100000:1.0:1788863891.658448:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298881152 00000100:00100000:1.0:1788863891.658554:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:1.0:1788863891.658568:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+8:13744:x1875759298881152:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788863891.659055:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+8:13744:x1875759298881152:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 488us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.659065:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:0.0:1788863891.674141:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863891.674247:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298881280 00000100:00100000:2.0:1788863891.674261:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298881280 00000100:00100000:2.0:1788863891.674331:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:2.0:1788863891.674342:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+8:13744:x1875759298881280:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788863891.674724:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+8:13744:x1875759298881280:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 381us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863891.674733:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:0.0:1788863891.685434:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863891.685585:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298881408 00000100:00100000:1.0:1788863891.685602:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298881408 00000100:00100000:1.0:1788863891.685680:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:1.0:1788863891.685693:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc75e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+8:13725:x1875759298881408:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788863891.685718:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863891.685761:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7b200/0x744cd7666bbbbed1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33124b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863891.685805:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7b200/0x744cd7666bbbbed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33124b expref: 9 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863891.685819:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7b200/0x744cd7666bbbbed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33124b expref: 9 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863891.685892:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b200, rc 0) 00000100:00100000:1.0:1788863891.685975:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc75e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+9:13725:x1875759298881408:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 284us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.685983:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:0.0:1788863891.695488:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863891.695630:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298881536 00000100:00100000:3.0:1788863891.695646:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298881536 00000100:00100000:3.0:1788863891.695722:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:3.0:1788863891.695735:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+9:13725:x1875759298881536:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788863891.695775:0:14313:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788863891.695798:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788863891.695803:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788863891.695806:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788863891.695809:0:14313:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788863891.698368:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+9:13725:x1875759298881536:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 2618us (2878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863891.698387:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:0.0:1788863891.701250:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863891.701381:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298881664 00000100:00100000:2.0:1788863891.701409:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298881664 00000100:00100000:2.0:1788863891.701529:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:2.0:1788863891.701541:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+9:13725:x1875759298881664:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788863891.701565:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863891.701600:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bee554400/0x744cd7666bbbbed8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331252 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863891.701638:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bee554400/0x744cd7666bbbbed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331252 expref: 10 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863891.701651:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bee554400/0x744cd7666bbbbed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331252 expref: 10 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863891.701662:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554400, rc 0) 00000100:00100000:2.0:1788863891.701737:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+10:13725:x1875759298881664:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 197us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863891.701745:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:0.0:1788863891.707159:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863891.707268:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298881792 00000100:00100000:2.0:1788863891.707281:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298881792 00000100:00100000:2.0:1788863891.707413:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:2.0:1788863891.707425:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+10:13725:x1875759298881792:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788863891.707813:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+10:13725:x1875759298881792:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 389us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863891.707822:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:0.0:1788863891.712424:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863891.712570:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298881920 00000100:00100000:2.0:1788863891.712593:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298881920 00000100:00100000:2.0:1788863891.712657:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:2.0:1788863891.712668:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+10:13725:x1875759298881920:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788863891.713271:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+10:13725:x1875759298881920:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 602us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863891.713281:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:0.0:1788863891.716223:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863891.716397:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298882048 00000100:00100000:2.0:1788863891.716414:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298882048 00000100:00100000:2.0:1788863891.716480:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:2.0:1788863891.716492:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+10:13749:x1875759298882048:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788863891.718925:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+10:13749:x1875759298882048:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 2418us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863891.718945:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:0.0:1788863891.732536:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863891.732664:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298882176 00000100:00100000:1.0:1788863891.732680:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298882176 00000100:00100000:1.0:1788863891.732766:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:1.0:1788863891.732779:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+10:13749:x1875759298882176:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788863891.733185:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+10:13749:x1875759298882176:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 407us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.733194:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:0.0:1788863891.749957:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863891.750945:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298882304 00000100:00100000:2.0:1788863891.750968:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298882304 00000100:00100000:2.0:1788863891.751035:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:2.0:1788863891.751045:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2349:x1875759298882304:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788863891.751095:0:14318:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c2d51fb3-4c9f-4aa1-ae4f-64214f247867@192.168.204.51@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:2.0:1788863891.751157:0:14318:0:(genops.c:1384:class_connect()) connect: client c2d51fb3-4c9f-4aa1-ae4f-64214f247867, cookie 0x744cd7666bbbbedf 00000004:00100000:2.0:1788863891.751197:0:14318:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788863891.751203:0:14318:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788863891.816359:0:14318:0:(import.c:65:import_set_state_nolock()) ffff8e8bf5bc2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863891.816957:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:2349:x1875759298882304:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 65431us (66534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.816976:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1788863891.824943:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863891.824986:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863891.825116:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298882432 00000100:00100000:3.0:1788863891.825130:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298882432 00000100:00100000:3.0:1788863891.825206:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298882560 00000100:00100000:3.0:1788863891.825210:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298882560 00000100:00100000:3.0:1788863891.825248:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1788863891.825259:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:0:x1875759298882432:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788863891.825315:0:14319:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788863891.825437:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:0:x1875759298882432:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 178us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863891.825445:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1788863891.825465:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:3.0:1788863891.825472:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:13725:x1875759298882560:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788863891.825495:0:14319:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788863891.825519:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:13725:x1875759298882560:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 48us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863891.825526:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00080000:0.0:1788863891.826206:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863891.833187:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863891.833267:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298882688 00000100:00100000:3.0:1788863891.833288:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298882688 00000100:00100000:3.0:1788863891.833377:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1788863891.833390:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:13725:x1875759298882688:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788863891.833675:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:13725:x1875759298882688:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 286us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863891.833684:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1788863891.837499:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863891.837546:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863891.837591:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863891.837816:0:15006:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298882816 00000100:00100000:1.0:1788863891.837835:0:15006:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298882816 00000100:00100000:1.0:1788863891.837939:0:15006:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298882944 00000100:00100000:1.0:1788863891.837943:0:15006:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298882944 00000100:00100000:1.0:1788863891.837978:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788863891.837988:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1875759298882816:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788863891.838021:0:15006:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c2d51fb3-4c9f-4aa1-ae4f-64214f247867@192.168.204.51@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:1.0:1788863891.838061:0:15006:0:(genops.c:1384:class_connect()) connect: client c2d51fb3-4c9f-4aa1-ae4f-64214f247867, cookie 0x744cd7666bbbbee6 00002000:00100000:1.0:1788863891.838076:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c2d51fb3-4c9f-4aa1-ae4f-64214f247867/ffff8e8bfd0df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788863891.838102:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788863891.838468:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788863891.839723:0:15006:0:(import.c:65:import_set_state_nolock()) ffff8e8bfd0db800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863891.839811:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:2349:x1875759298882816:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 1821us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.839821:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788863891.840057:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1788863891.840065:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1875759298882944:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788863891.840093:0:15006:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c2d51fb3-4c9f-4aa1-ae4f-64214f247867@192.168.204.51@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:1.0:1788863891.840130:0:15006:0:(genops.c:1384:class_connect()) connect: client c2d51fb3-4c9f-4aa1-ae4f-64214f247867, cookie 0x744cd7666bbbbeed 00002000:00100000:1.0:1788863891.840144:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c2d51fb3-4c9f-4aa1-ae4f-64214f247867/ffff8e8bfd0dc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788863891.840174:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788863891.842114:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788863891.842164:0:15006:0:(import.c:65:import_set_state_nolock()) ffff8e8bfd0de000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788863891.842234:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:2349:x1875759298882944:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 2167us (4641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863891.842245:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1788863891.844494:0:14321:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298883072 00000100:00100000:3.0:1788863891.844519:0:14321:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298883072 00000100:00100000:3.0:1788863891.844624:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1788863891.844638:0:14321:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:13725:x1875759298883072:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788863891.847523:0:14321:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2782us 00000004:00200000:3.0:1788863891.918755:0:14321:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788863891.918916:0:14321:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:13725:x1875759298883072:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 74275us (81428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863891.918926:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:0.0:1788863892.172209:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863892.172341:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298883200 00000100:00100000:1.0:1788863892.172356:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298883200 00000100:00100000:1.0:1788863892.172437:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1788863892.172449:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:13770:x1875759298883200:12345-192.168.204.51@tcp:101:mkdir.0 00010000:00010000:1.0:1788863892.172479:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863892.172529:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbbef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33127c expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863892.172682:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbbefb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863892.172701:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbbefb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863892.172724:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbbefb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863892.172776:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788863892.172781:0:14318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788863892.172832:0:14318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbbefb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863892.172905:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbbef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33127c expref: 8 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863892.172927:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbbefb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33127c expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863892.172937:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:1.0:1788863892.172940:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863892.172944:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a800, rc 0) 00000100:00100000:1.0:1788863892.173031:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:13770:x1875759298883200:12345-192.168.204.51@tcp:101:mkdir.0 Request processed in 583us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863892.173039:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00010000:00010000:0.0:1788863892.632496:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788863892.637166:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2d51fb3-4c9f-4aa1-ae4f-64214f247867 00010000:00010000:3.0:1788863893.654111:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863894.368889:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863894.369057:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298883328 00000100:00100000:3.0:1788863894.369071:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298883328 00000100:00100000:3.0:1788863894.369167:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:3.0:1788863894.369181:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:13823:x1875759298883328:12345-192.168.204.51@tcp:41:lfs.0 00000100:00080000:0.0:1788863894.369335:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788863894.369411:0:14319:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788863894.369848:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:13823:x1875759298883328:12345-192.168.204.51@tcp:41:lfs.0 Request processed in 668us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863894.369887:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1788863894.376703:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863894.376988:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298883456 00000100:00100000:3.0:1788863894.377003:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298883456 00000100:00100000:3.0:1788863894.377100:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1788863894.377114:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:13823:x1875759298883456:12345-192.168.204.51@tcp:13:lfs.0 00002000:00000024:3.0:1788863894.377177:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863894.377462:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:13823:x1875759298883456:12345-192.168.204.51@tcp:13:lfs.0 Request processed in 350us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863894.377473:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00080000:0.0:1788863894.378685:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863894.381484:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863894.381588:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298883584 00000100:00100000:3.0:1788863894.381608:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298883584 00000100:00100000:3.0:1788863894.381953:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1788863894.381972:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:13823:x1875759298883584:12345-192.168.204.51@tcp:13:lfs.0 00002000:00000024:3.0:1788863894.382040:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788863894.382364:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863894.383466:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:13823:x1875759298883584:12345-192.168.204.51@tcp:13:lfs.0 Request processed in 1491us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863894.383480:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1788863894.550965:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863894.551148:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298883712 00000100:00100000:2.0:1788863894.551166:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298883712 00000100:00100000:2.0:1788863894.551242:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:2.0:1788863894.551254:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+10:13855:x1875759298883712:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788863894.551275:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863894.553545:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbf02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331283 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863894.553588:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbf02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331283 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863894.553600:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bee554800/0x744cd7666bbbbf02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331283 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863894.553610:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554800, rc 0) 00000100:00100000:2.0:1788863894.553700:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+11:13855:x1875759298883712:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 2447us (2747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863894.557038:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:2.0:1788863894.565497:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863894.565799:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298883840 00000100:00100000:1.0:1788863894.565822:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298883840 00000100:00100000:1.0:1788863894.565994:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:1.0:1788863894.566008:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+11:13855:x1875759298883840:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788863894.566604:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+11:13855:x1875759298883840:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 594us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863894.566617:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:0.0:1788863894.578810:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863894.579239:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298883968 00000100:00100000:2.0:1788863894.579256:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298883968 00000100:00100000:2.0:1788863894.579350:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:2.0:1788863894.579361:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+11:13855:x1875759298883968:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788863894.579734:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+11:13855:x1875759298883968:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 372us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863894.579744:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:0.0:1788863894.588422:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863894.589868:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298884096 00000100:00100000:1.0:1788863894.589892:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298884096 00000100:00100000:1.0:1788863894.589981:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:1.0:1788863894.589994:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+11:13862:x1875759298884096:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788863894.590815:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+11:13862:x1875759298884096:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 816us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863894.590828:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:3.0:1788863894.612251:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863894.612457:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298884224 00000100:00100000:1.0:1788863894.612475:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298884224 00000100:00100000:1.0:1788863894.612591:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:1.0:1788863894.612605:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+11:13862:x1875759298884224:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788863894.613452:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+11:13862:x1875759298884224:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 843us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863894.613464:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:1.0:1788863894.614117:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324043648:0@lo:400:kworker.0 00000100:00100000:1.0:1788863894.614181:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863894.614249:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759324044160:0@lo:400:kworker.0 00000100:00100000:1.0:1788863894.614296:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863894.614324:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863894.614331:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324043776:0@lo:400:kworker.0 00000100:00100000:1.0:1788863894.614353:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863894.614417:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324044160 00000100:00100000:1.0:1788863894.614426:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324044160 00000100:00100000:1.0:1788863894.614487:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788863894.614495:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759324044160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863894.614559:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759324044160:12345-0@lo:400:kworker.0 Request processed in 64us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863894.614566:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788863894.614590:0:15908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324043648 00000100:00100000:1.0:1788863894.614594:0:15908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324043648 00000100:00100000:1.0:1788863894.614622:0:15908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324043776 00000100:00100000:1.0:1788863894.614625:0:15908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324043776 00000100:00100000:1.0:1788863894.614649:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863894.614655:0:15908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324043648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863894.614690:0:15908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324043648:12345-0@lo:400:kworker.0 Request processed in 35us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863894.614696:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788863894.614707:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863894.614713:0:15908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324043776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863894.614743:0:15908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324043776:12345-0@lo:400:kworker.0 Request processed in 31us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863894.614749:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788863894.614801:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788863894.614827:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324043776:0@lo:400:kworker.0 00000100:00100000:1.0:1788863894.614877:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324043648:0@lo:400:kworker.0 00000100:00100000:1.0:1788863894.614890:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759324044160:0@lo:400:kworker.0 00000100:00080000:1.0:1788863894.614933:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863894.614938:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863894.614941:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863894.615196:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324043520:0@lo:400:kworker.0 00000100:00100000:2.0:1788863894.615247:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863894.615280:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759324044032:0@lo:400:kworker.0 00000100:00100000:2.0:1788863894.615306:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863894.615328:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863894.615335:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759324043904:0@lo:400:kworker.0 00000100:00100000:2.0:1788863894.615370:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863894.615402:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324044032 00000100:00100000:2.0:1788863894.615407:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324044032 00000100:00100000:2.0:1788863894.615442:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324043904 00000100:00100000:2.0:1788863894.615445:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324043904 00000100:00100000:2.0:1788863894.615463:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788863894.615470:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759324044032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863894.615507:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759324044032:12345-0@lo:400:kworker.0 Request processed in 37us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863894.615526:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788863894.615541:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788863894.615547:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759324043904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863894.615574:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759324043904:12345-0@lo:400:kworker.0 Request processed in 28us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863894.615580:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788863894.615596:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863894.615616:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759324043904:0@lo:400:kworker.0 00000100:00100000:2.0:1788863894.615626:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759324044032:0@lo:400:kworker.0 00000100:00100000:2.0:1788863894.615663:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324043520 00000100:00100000:2.0:1788863894.615666:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324043520 00000100:00100000:2.0:1788863894.615691:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788863894.615697:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+19:3307:x1875759324043520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863894.615731:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+19:3307:x1875759324043520:12345-0@lo:400:kworker.0 Request processed in 35us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863894.615737:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788863894.615768:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324043520:0@lo:400:kworker.0 00000100:00100000:3.0:1788863894.616108:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788863894.616122:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324044288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863894.616161:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863894.616239:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324044288 00000100:00100000:1.0:1788863894.616244:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324044288 00000100:00100000:1.0:1788863894.616283:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788863894.616292:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324044288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788863894.616312:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788863894.616362:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324044288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863894.616369:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788863894.616452:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324044288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863894.622749:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863894.623024:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298884352 00000100:00100000:1.0:1788863894.623039:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298884352 00000100:00100000:1.0:1788863894.623234:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:1.0:1788863894.623249:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+11:13855:x1875759298884352:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788863894.623281:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863894.623309:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7a600/0x744cd7666bbbbf09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3312ad expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863894.623356:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7a600/0x744cd7666bbbbf09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312ad expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863894.623373:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7a600/0x744cd7666bbbbf09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312ad expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863894.623404:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a600, rc 0) 00000100:00100000:0.0:1788863894.623800:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+12:13855:x1875759298884352:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 551us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863894.623810:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:2.0:1788863894.626493:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863894.626545:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298884480 00000100:00100000:1.0:1788863894.626560:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298884480 00000100:00100000:1.0:1788863894.626663:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:1.0:1788863894.626674:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+12:13855:x1875759298884480:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788863894.626710:0:14313:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788863894.626743:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788863894.626748:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788863894.626756:0:14313:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788863894.626760:0:14313:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788863894.629311:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+12:13855:x1875759298884480:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 2619us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863894.629334:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:2.0:1788863894.634019:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863894.634300:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298884608 00000100:00100000:0.0:1788863894.634317:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298884608 00000100:00100000:0.0:1788863894.634433:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:0.0:1788863894.634447:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+12:13855:x1875759298884608:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788863894.634489:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863894.634533:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bfeb65a00/0x744cd7666bbbbf10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3312b4 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863894.634576:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bfeb65a00/0x744cd7666bbbbf10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312b4 expref: 13 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863894.634590:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bfeb65a00/0x744cd7666bbbbf10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312b4 expref: 13 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863894.634600:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfeb65a00, rc 0) 00000100:00100000:0.0:1788863894.634701:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+13:13855:x1875759298884608:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 255us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863894.634710:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:2.0:1788863894.637480:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863894.637585:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298884736 00000100:00100000:1.0:1788863894.637601:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298884736 00000100:00100000:1.0:1788863894.637677:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:1.0:1788863894.637690:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+13:13855:x1875759298884736:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788863894.638532:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+13:13855:x1875759298884736:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 830us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863894.638542:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:1.0:1788863894.640330:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863894.640466:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298884864 00000100:00100000:0.0:1788863894.640478:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298884864 00000100:00100000:0.0:1788863894.640555:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:0.0:1788863894.640567:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+13:13855:x1875759298884864:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788863894.640943:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+13:13855:x1875759298884864:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 376us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863894.640953:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 102 00000001:00100000:2.0:1788863894.645039:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c2d51fb3-4c9f-4aa1-ae4f-64214f247867 00000100:00100000:1.0:1788863894.645205:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863894.645311:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298884992 00000100:00100000:2.0:1788863894.645335:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298884992 00000100:00100000:2.0:1788863894.645468:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:2.0:1788863894.645481:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+13:13867:x1875759298884992:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788863894.645841:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+13:13867:x1875759298884992:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 361us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863894.645996:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:2.0:1788863894.654405:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863894.654566:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298885120 00000100:00100000:0.0:1788863894.654582:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298885120 00000100:00100000:0.0:1788863894.654661:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:0.0:1788863894.654677:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+13:13867:x1875759298885120:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788863894.656545:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+13:13867:x1875759298885120:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 1843us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863894.656578:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:1.0:1788863894.663491:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863894.667031:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298885248 00000100:00100000:2.0:1788863894.667061:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298885248 00000100:00100000:2.0:1788863894.667167:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1788863894.667180:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1875759298885248:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788863894.667238:0:14320:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f576e463-13c4-424a-a092-65e3da1791c5@192.168.204.51@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1788863894.667297:0:14320:0:(genops.c:1384:class_connect()) connect: client f576e463-13c4-424a-a092-65e3da1791c5, cookie 0x744cd7666bbbbf17 00000004:00100000:2.0:1788863894.667358:0:14320:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788863894.667590:0:14320:0:(import.c:65:import_set_state_nolock()) ffff8e8ac259c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788863894.667718:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f576e463-13c4-424a-a092-65e3da1791c5+6:2349:x1875759298885248:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 539us (4243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863894.667729:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1788863894.673352:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863894.673480:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298885376 00000100:00100000:3.0:1788863894.673500:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298885376 00000100:00100000:3.0:1788863894.673623:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788863894.673638:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+6:0:x1875759298885376:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788863894.673694:0:14319:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788863894.673815:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+6:0:x1875759298885376:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 179us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863894.673823:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00080000:2.0:1788863894.674784:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863894.680576:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:0.0:1788863894.680759:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863894.683015:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298885504 00000100:00100000:1.0:1788863894.683074:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298885504 00000100:00100000:1.0:1788863894.683183:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1788863894.683197:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f576e463-13c4-424a-a092-65e3da1791c5+6:13855:x1875759298885504:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788863894.683249:0:14318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788863894.683403:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f576e463-13c4-424a-a092-65e3da1791c5+6:13855:x1875759298885504:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 208us (3516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863894.683412:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1788863894.687671:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863894.687835:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298885632 00000100:00100000:1.0:1788863894.687849:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298885632 00000100:00100000:1.0:1788863894.687963:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1788863894.687976:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f576e463-13c4-424a-a092-65e3da1791c5+6:13855:x1875759298885632:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788863894.688419:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f576e463-13c4-424a-a092-65e3da1791c5+6:13855:x1875759298885632:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 330us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863894.688427:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1788863894.695143:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863894.695228:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863894.695276:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863894.695464:0:15006:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298885760 00000100:00100000:3.0:1788863894.695481:0:15006:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298885760 00000100:00100000:3.0:1788863894.695545:0:15006:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298885888 00000100:00100000:3.0:1788863894.695549:0:15006:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298885888 00000100:00100000:3.0:1788863894.695573:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788863894.695585:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1875759298885760:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788863894.695638:0:15006:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f576e463-13c4-424a-a092-65e3da1791c5@192.168.204.51@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:3.0:1788863894.695692:0:15006:0:(genops.c:1384:class_connect()) connect: client f576e463-13c4-424a-a092-65e3da1791c5, cookie 0x744cd7666bbbbf1e 00002000:00100000:3.0:1788863894.695711:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f576e463-13c4-424a-a092-65e3da1791c5/ffff8e8ac1f43000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788863894.695740:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788863894.696177:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788863894.696228:0:15006:0:(import.c:65:import_set_state_nolock()) ffff8e8ac1f41000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863894.696327:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f576e463-13c4-424a-a092-65e3da1791c5+6:2349:x1875759298885760:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 743us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863894.696337:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788863894.696366:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1788863894.696372:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1875759298885888:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788863894.696394:0:15006:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f576e463-13c4-424a-a092-65e3da1791c5@192.168.204.51@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:3.0:1788863894.696416:0:15006:0:(genops.c:1384:class_connect()) connect: client f576e463-13c4-424a-a092-65e3da1791c5, cookie 0x744cd7666bbbbf25 00002000:00100000:3.0:1788863894.696425:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f576e463-13c4-424a-a092-65e3da1791c5/ffff8e8bc2bd9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788863894.696434:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788863894.696599:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788863894.696619:0:15006:0:(import.c:65:import_set_state_nolock()) ffff8e8ac247e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788863894.696647:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f576e463-13c4-424a-a092-65e3da1791c5+6:2349:x1875759298885888:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 274us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863894.696654:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1788863894.697004:0:14322:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298886016 00000100:00100000:0.0:1788863894.697014:0:14322:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298886016 00000100:00100000:0.0:1788863894.697069:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:0.0:1788863894.697077:0:14322:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f576e463-13c4-424a-a092-65e3da1791c5+6:13855:x1875759298886016:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788863894.697167:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788863894.697237:0:14322:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f576e463-13c4-424a-a092-65e3da1791c5+6:13855:x1875759298886016:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 161us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863894.697244:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1788863894.900539:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863894.901520:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298886144 00000100:00100000:0.0:1788863894.901535:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298886144 00000100:00100000:0.0:1788863894.901617:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:0.0:1788863894.901629:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+6:13888:x1875759298886144:12345-192.168.204.51@tcp:101:mkdir.0 00010000:00010000:0.0:1788863894.901653:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863894.901691:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65e00/0x744cd7666bbbbf2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3312de expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863894.901770:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbbf33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863894.901786:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbbf33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863894.901802:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbbf33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863894.902126:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788863894.902131:0:14319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788863894.902157:0:14319:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbbf33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863894.902194:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65e00/0x744cd7666bbbbf2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312de expref: 8 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863894.902214:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbbf33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312de expref: 7 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863894.902223:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:0.0:1788863894.902227:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788863894.902230:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfeb64600, rc 0) 00000100:00100000:0.0:1788863894.902301:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+7:13888:x1875759298886144:12345-192.168.204.51@tcp:101:mkdir.0 Request processed in 674us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863894.902308:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:1.0:1788863895.638597:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324044416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863895.638690:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863895.638839:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324044416 00000100:00100000:3.0:1788863895.638848:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324044416 00000100:00100000:3.0:1788863895.638930:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788863895.638938:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324044416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863895.638962:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863895.639012:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324044416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863895.639036:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788863895.639668:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324044416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788863895.703618:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863896.089313:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788863896.728759:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788863897.269137:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c2d51fb3-4c9f-4aa1-ae4f-64214f247867 00000001:00100000:2.0:1788863897.269162:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f576e463-13c4-424a-a092-65e3da1791c5 00000001:00100000:1.0:1788863897.729465:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f576e463-13c4-424a-a092-65e3da1791c5 00010000:00010000:3.0:1788863897.750137:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863897.845227:0:16287:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788863898.777315:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863899.734391:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324044544:0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.734528:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863899.734592:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759324045056:0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.734627:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863899.734661:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863899.734666:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759324044928:0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.734716:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863899.734756:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324044672:0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.734792:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863899.734814:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759324045184:0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.734836:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863899.734882:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863899.734889:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324044800:0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.734914:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863899.737464:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324044544 00000100:00100000:1.0:1788863899.737489:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324044544 00000100:00100000:1.0:1788863899.737564:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788863899.737577:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+19:3307:x1875759324044544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.737695:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+19:3307:x1875759324044544:12345-0@lo:400:kworker.0 Request processed in 120us (3168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.737703:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788863899.737779:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324045056 00000100:00100000:1.0:1788863899.737785:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324045056 00000100:00100000:0.0:1788863899.738091:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324044928 00000100:00100000:0.0:1788863899.738097:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324044928 00000100:00100000:0.0:1788863899.738384:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324045184 00000100:00100000:0.0:1788863899.738390:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324045184 00000100:00100000:1.0:1788863899.738472:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788863899.738482:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759324044928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.738546:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875759324044928:12345-0@lo:400:kworker.0 Request processed in 64us (3828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.738553:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788863899.738567:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788863899.738574:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759324045056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.738601:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759324045056:12345-0@lo:400:kworker.0 Request processed in 30us (3974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.738618:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788863899.740692:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863899.740715:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759324045184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863899.740890:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875759324045184:12345-0@lo:400:kworker.0 Request processed in 183us (6052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863899.741086:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788863899.741204:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875759324045184:0@lo:400:kworker.0 00000100:00100000:0.0:1788863899.742305:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324045312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863899.742411:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863899.742497:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324045312 00000100:00100000:0.0:1788863899.742508:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324045312 00000100:00100000:0.0:1788863899.742570:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788863899.742579:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324045312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788863899.742628:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788863899.742674:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324045312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863899.742682:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788863899.744234:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324045312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863899.744289:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324044672 00000100:00100000:2.0:1788863899.744299:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324044672 00000100:00100000:1.0:1788863899.744430:0:15006:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324044800 00000100:00100000:1.0:1788863899.744436:0:15006:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324044800 00000100:00100000:2.0:1788863899.744448:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788863899.744458:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324044672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.744471:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788863899.744478:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324044800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.749311:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324044800:12345-0@lo:400:kworker.0 Request processed in 4812us (14374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.749338:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788863899.749406:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863899.749430:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863899.749435:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863899.750028:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324044800:0@lo:400:kworker.0 00000100:00100000:2.0:1788863899.752291:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324044672:12345-0@lo:400:kworker.0 Request processed in 7815us (17480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863899.752314:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863899.752324:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324044672:0@lo:400:kworker.0 00000100:00100000:0.0:1788863899.752547:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875759324044928:0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.752625:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324044544:0@lo:400:kworker.0 00000100:00100000:1.0:1788863899.752643:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759324045056:0@lo:400:kworker.0 00010000:00010000:0.0:1788863899.807228:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788863899.859828:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f576e463-13c4-424a-a092-65e3da1791c5 00000100:00100000:1.0:1788863899.974054:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863899.974110:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863899.974142:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863899.974166:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863899.974186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863899.974209:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863899.974237:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863899.974276:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298886528 00000100:00100000:1.0:1788863899.974292:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298886528 00000100:00100000:1.0:1788863899.974379:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298887040 00000100:00100000:1.0:1788863899.974382:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298887040 00000100:00100000:1.0:1788863899.974397:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298886656 00000100:00100000:1.0:1788863899.974399:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298886656 00000100:00100000:1.0:1788863899.974425:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298886912 00000100:00100000:1.0:1788863899.974428:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298886912 00000100:00100000:1.0:1788863899.974448:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1788863899.974459:0:15003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2350:x1875759298886528:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863899.974564:0:15003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2350:x1875759298886528:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 106us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.974574:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1788863899.974602:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788863899.974609:0:15003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f576e463-13c4-424a-a092-65e3da1791c5+5:2350:x1875759298887040:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863899.974637:0:15003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f576e463-13c4-424a-a092-65e3da1791c5+5:2350:x1875759298887040:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.974644:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788863899.974654:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1788863899.974661:0:15003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2350:x1875759298886656:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863899.974687:0:15003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2350:x1875759298886656:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.974694:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1788863899.974705:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:1.0:1788863899.974711:0:15003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f576e463-13c4-424a-a092-65e3da1791c5+5:2350:x1875759298886912:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863899.974754:0:15003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f576e463-13c4-424a-a092-65e3da1791c5+5:2350:x1875759298886912:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 42us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.974773:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:1.0:1788863899.974797:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298886784 00000100:00100000:1.0:1788863899.974803:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298886784 00000100:00100000:1.0:1788863899.974841:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298886400 00000100:00100000:1.0:1788863899.974845:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298886400 00000100:00100000:1.0:1788863899.974898:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:1.0:1788863899.974904:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+6:2350:x1875759298886784:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863899.974941:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+6:2350:x1875759298886784:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 36us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.974947:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:1.0:1788863899.974959:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:1.0:1788863899.974965:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:2350:x1875759298886400:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863899.975011:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:2350:x1875759298886400:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 44us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863899.975017:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00080000:1.0:1788863899.975055:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863899.975061:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863899.975064:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863899.975681:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298886272 00000100:00100000:3.0:1788863899.975693:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298886272 00000100:00100000:3.0:1788863899.975752:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:3.0:1788863899.975762:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+13:2350:x1875759298886272:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863899.975816:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+13:2350:x1875759298886272:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 57us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863899.975823:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:2.0:1788863900.760426:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788863900.760469:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324045440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863900.760604:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863900.760755:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324045440 00000100:00100000:3.0:1788863900.760770:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324045440 00000100:00100000:3.0:1788863900.760880:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788863900.760894:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324045440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863900.760948:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863900.761015:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324045440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863900.761023:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788863900.762189:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324045440:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788863900.823509:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863901.851906:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788863902.465983:0:16435:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd62718fd0 20000000:00000080:0.0:1788863902.466008:0:16435:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8ac3235000 uarg=0000000000000000 20000000:01000000:0.0:1788863902.466055:0:16435:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788863902.466062:0:16435:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788863902.466068:0:16435:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788863902.469164:0:16436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788863902.474460:0:16435:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788863902.483613:0:16435:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788863902.483654:0:16435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.483676:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbbc31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbc2a expref: 18 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.483709:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bff18be00/0x744cd7666bbbbc7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbc77 expref: 18 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.483715:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bfe994600/0x744cd7666bbbbdb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbdb2 expref: 18 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.483725:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bee554400/0x744cd7666bbbbed8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331252 expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.483733:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8bfeb65a00/0x744cd7666bbbbf10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312b4 expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.484356:0:16435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.484426:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bfeb65a00/0x744cd7666bbbbf10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312b4 expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.484444:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bfeb65a00/0x744cd7666bbbbf10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312b4 expref: 12 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.484462:0:16435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee553480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1875759324045568:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863902.484628:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bee554400/0x744cd7666bbbbed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331252 expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.484637:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bee554400/0x744cd7666bbbbed8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331252 expref: 12 pid: 14312 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.484645:0:16435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee550000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1875759324045696:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863902.484690:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bfe994600/0x744cd7666bbbbdb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbbdb2 expref: 18 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.484699:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bfe994600/0x744cd7666bbbbdb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbbdb2 expref: 18 pid: 14313 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.484721:0:16435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee552a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1875759324045824:0@lo:104: 00000100:00100000:1.0:1788863902.484774:0:16435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788863902.485505:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bff18be00/0x744cd7666bbbbc7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbbc77 expref: 18 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.485517:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bff18be00/0x744cd7666bbbbc7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbbc77 expref: 18 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.485528:0:16435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee551f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1875759324045952:0@lo:104: 00000100:00100000:1.0:1788863902.485559:0:16435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788863902.498480:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbbc31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x744cd7666bbbbc2a expref: 18 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.498508:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbbc31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x744cd7666bbbbc2a expref: 18 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.498529:0:16435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee553b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1875759324046080:0@lo:104: 00000100:00100000:1.0:1788863902.498614:0:16435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863902.503046:0:14301:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324045824 00000100:00100000:3.0:1788863902.503134:0:14301:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324045824 00000100:00100000:1.0:1788863902.507920:0:16435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbbd3000 going to sleep for 11 seconds 00000100:00100000:3.0:1788863902.509737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863902.510014:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863902.510122:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298887168 00000100:00100000:3.0:1788863902.510134:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298887168 00010000:00010000:3.0:1788863902.510268:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bfeb65a00/0x744cd7666bbbbf10 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312b4 expref: 13 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863902.510335:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298887296 00000100:00100000:3.0:1788863902.510338:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298887296 00010000:00010000:3.0:1788863902.510352:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bee554400/0x744cd7666bbbbed8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331252 expref: 14 pid: 14312 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863902.510380:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1788863902.510835:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:757561f2-9678-4319-9860-6d7710ce5d8a+14:2351:x1875759298887168:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863902.511260:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863902.511272:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bfeb65a00/0x744cd7666bbbbf10 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312b4 expref: 14 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.511291:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bfeb65a00/0x744cd7666bbbbf10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312b4 expref: 14 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.511315:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863902.511826:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:757561f2-9678-4319-9860-6d7710ce5d8a+14:2351:x1875759298887168:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1433us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863902.511839:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1788863902.511990:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1788863902.512006:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:757561f2-9678-4319-9860-6d7710ce5d8a+13:2351:x1875759298887296:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863902.512020:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863902.512028:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bee554400/0x744cd7666bbbbed8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331252 expref: 13 pid: 14312 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.512043:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bee554400/0x744cd7666bbbbed8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331252 expref: 13 pid: 14312 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.512217:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863902.512257:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:757561f2-9678-4319-9860-6d7710ce5d8a+13:2351:x1875759298887296:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 257us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863902.512264:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1788863902.513066:0:14302:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324045952 00000100:00100000:0.0:1788863902.513078:0:14302:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324045952 00000100:00100000:0.0:1788863902.513125:0:14302:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788863902.513299:0:14302:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324046080 00000100:00100000:0.0:1788863902.513304:0:14302:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324046080 00000100:00100000:0.0:1788863902.513335:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863902.513342:0:14302:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+5:16435:x1875759324045952:12345-0@lo:104: 00010000:00010000:0.0:1788863902.513358:0:14302:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbc7e expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.513459:0:14302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788863902.513981:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863902.513990:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbc7e expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.513999:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ac00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:3.0:1788863902.514003:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbbc7e expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.514013:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbbc7e expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788863902.514020:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbbc7e expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788863902.514026:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788863902.514151:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbc7e expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.514159:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788863902.514189:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbc7e expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.514199:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bf4e7ac00/0x744cd7666bbbbc77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbc7e expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.514232:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863902.514235:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863902.514236:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863902.514249:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863902.514269:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98ce9f4a-6069-439b-828d-fac2605e9de4:3306:1875759324046208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863902.514329:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863902.514403:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324046208 00000100:00100000:3.0:1788863902.514409:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324046208 00010000:00010000:3.0:1788863902.514432:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bff18be00/0x744cd7666bbbbc7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbc77 expref: 19 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863902.514455:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788863902.514462:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+19:3306:x1875759324046208:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863902.514570:0:14302:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+5:16435:x1875759324045952:12345-0@lo:104: Request processed in 124us (27906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863902.514582:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788863902.514703:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788863902.514713:0:14302:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c49c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+4:16435:x1875759324046080:12345-0@lo:104: 00010000:00010000:0.0:1788863902.514727:0:14302:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbc31 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.514929:0:16435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bfeb65a00/0x744cd7666bbbbf10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312b4 expref: 12 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.514943:0:16435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee553480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1875759324045568:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863902.514974:0:16435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bee554400/0x744cd7666bbbbed8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331252 expref: 11 pid: 14312 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.514984:0:16435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee550000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1875759324045696:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863902.514996:0:16435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee551f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1875759324045952:0@lo:104: 00000100:00100000:1.0:1788863902.515002:0:16435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee553b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1875759324046080:0@lo:104: 00010000:00010000:1.0:1788863902.515035:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863902.515036:0:14302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788863902.515041:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbc31 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863902.515045:0:14302:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c49c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+4:16435:x1875759324046080:12345-0@lo:104: Request processed in 334us (16430us total) trans 0 rc 0/0 00010000:00010000:1.0:1788863902.515048:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bff18ac00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:1.0:1788863902.515053:0:14307:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbbc31 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.515061:0:14307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbbc31 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788863902.515069:0:14307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbbc31 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788863902.515075:0:14307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788863902.515118:0:14307:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbc31 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.515125:0:14307:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863902.515149:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbc31 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.515156:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bff18ac00/0x744cd7666bbbbc2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbc31 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863902.515174:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863902.515176:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863902.515177:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788863902.515178:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863902.515192:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98ce9f4a-6069-439b-828d-fac2605e9de4:3308:1875759324046336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863902.515223:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863902.515293:0:14305:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788863902.515304:0:14305:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788863902.516084:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788863902.516096:0:14302:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+3:16435:x1875759324045824:12345-0@lo:104: 00010000:00010000:0.0:1788863902.516115:0:14302:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbdb9 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.516368:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863902.516377:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bff18be00/0x744cd7666bbbbc7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbc77 expref: 19 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.517030:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bff18be00/0x744cd7666bbbbc7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbbc77 expref: 19 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.517070:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bff18be00/0x744cd7666bbbbc7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbbc77 expref: 19 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.517091:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863902.517218:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+18:3306:x1875759324046208:12345-0@lo:103:ldlm_bl.0 Request processed in 2754us (2887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863902.517230:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788863902.517252:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98ce9f4a-6069-439b-828d-fac2605e9de4:3306:1875759324046208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863902.517305:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324046336 00000100:00100000:3.0:1788863902.517334:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324046336 00010000:00010000:3.0:1788863902.517372:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbbc31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbc2a expref: 18 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863902.517391:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788863902.517401:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+18:3308:x1875759324046336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863902.517411:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863902.517415:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbbc31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbc2a expref: 18 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.517423:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbbc31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbbc2a expref: 18 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.517433:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bee554000/0x744cd7666bbbbc31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbbc2a expref: 18 pid: 14311 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.517442:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863902.518078:0:14302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788863902.518088:0:14302:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+3:16435:x1875759324045824:12345-0@lo:104: Request processed in 1995us (33313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863902.518109:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788863902.518162:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863902.518169:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x744cd7666bbbbdb9 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.518178:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfe994e00 already unused, calling callback (ffffffffc1badc20) 10000000:00010000:0.0:1788863902.518184:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x744cd7666bbbbdb9 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.518193:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x744cd7666bbbbdb9 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863902.518200:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x744cd7666bbbbdb9 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.518206:0:16435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee552a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1875759324045824:0@lo:104: 10000000:01000000:0.0:1788863902.518206:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788863902.518243:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbdb9 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.518249:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788863902.518261:0:16435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863902.518406:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98ce9f4a-6069-439b-828d-fac2605e9de4+17:3308:x1875759324046336:12345-0@lo:103:ldlm_bl.0 Request processed in 1007us (3182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863902.518414:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788863902.518550:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbdb9 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.518558:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8e8bfe994e00/0x744cd7666bbbbdb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x744cd7666bbbbdb9 expref: -99 pid: 15722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.518574:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863902.518576:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863902.518578:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863902.518765:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98ce9f4a-6069-439b-828d-fac2605e9de4:3309:1875759324046464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863902.518811:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863902.518904:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324046464 00000100:00100000:0.0:1788863902.518908:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324046464 00010000:00010000:0.0:1788863902.518927:0:14305:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8bfe994600/0x744cd7666bbbbdb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbdb2 expref: 17 pid: 14313 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863902.518949:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863902.518955:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:98ce9f4a-6069-439b-828d-fac2605e9de4+17:3309:x1875759324046464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788863902.518964:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863902.518968:0:14305:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8bfe994600/0x744cd7666bbbbdb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x744cd7666bbbbdb2 expref: 17 pid: 14313 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.518978:0:14305:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8bfe994600/0x744cd7666bbbbdb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x744cd7666bbbbdb2 expref: 17 pid: 14313 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.518990:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bfe994600/0x744cd7666bbbbdb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x744cd7666bbbbdb2 expref: 17 pid: 14313 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.519002:0:14305:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.519011:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.519024:0:14305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.519031:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.519039:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.519062:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.519068:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b600 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863902.519073:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.519081:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.519093:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863902.519102:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863902.519128:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:98ce9f4a-6069-439b-828d-fac2605e9de4+16:3309:x1875759324046464:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863902.519134:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788863902.519161:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98ce9f4a-6069-439b-828d-fac2605e9de4:3309:1875759324046464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788863902.520032:0:16435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.520043:0:16435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863902.520105:0:16435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8bf4e7b600/0x744cd7666bbbbf3a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863902.529620:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98ce9f4a-6069-439b-828d-fac2605e9de4:3308:1875759324046336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788863902.870423:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863903.896587:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788863904.281947:0:14316:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788863904.281963:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bf5bc0800 from 10 10000000:01000000:2.0:1788863904.281971:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788863904.282066:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bee555c00/0x744cd7666bbbbf41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863904.282081:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bee555c00/0x744cd7666bbbbf41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863904.282096:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bee555c00/0x744cd7666bbbbf41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863904.282164:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324046592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.282290:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863904.282371:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd03a6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863904.282734:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324046592 00000100:00100000:0.0:1788863904.282747:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324046592 00000100:00100000:0.0:1788863904.282811:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788863904.282824:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+16:14316:x1875759324046592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863904.282846:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863904.282898:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bfeb65e00/0x744cd7666bbbbf48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbf41 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863904.282935:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bfeb65e00/0x744cd7666bbbbf48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbf41 expref: 17 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863904.282967:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bfeb65e00/0x744cd7666bbbbf48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbf41 expref: 17 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863904.282979:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfeb65e00, rc 0) 00000100:00100000:0.0:1788863904.283063:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+17:14316:x1875759324046592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863904.283070:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788863904.284063:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324046592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863904.284102:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bee555c00/0x744cd7666bbbbf41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbf48 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863904.284117:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bee555c00/0x744cd7666bbbbf41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbf48 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863904.284246:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324046720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.284322:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863904.284377:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd03a6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788863904.284549:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324046720 00000100:00100000:3.0:1788863904.284573:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324046720 00000100:00100000:3.0:1788863904.284625:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788863904.284636:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+17:14316:x1875759324046720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788863904.285089:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98ce9f4a-6069-439b-828d-fac2605e9de4+17:14316:x1875759324046720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 453us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863904.285097:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788863904.286875:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324046720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.286985:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324046848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.287105:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863904.287165:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd03a6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863904.287298:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324046848 00000100:00100000:0.0:1788863904.287310:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324046848 00000100:00100000:0.0:1788863904.287393:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788863904.287407:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+17:14316:x1875759324046848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863904.287721:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+17:14316:x1875759324046848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 316us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863904.287731:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788863904.288070:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324046848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788863904.295706:0:16478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788863904.296267:0:14316:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788863904.296319:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788863904.296349:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bee555c00/0x744cd7666bbbbf41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbf48 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863904.296365:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bee555c00/0x744cd7666bbbbf41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbf48 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863904.296380:0:14316:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788863904.296384:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8becca5000 from 10 10000000:01000000:0.0:1788863904.296388:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788863904.296451:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bfeb64800/0x744cd7666bbbbf4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863904.296477:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bfeb64800/0x744cd7666bbbbf4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863904.296494:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bfeb64800/0x744cd7666bbbbf4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863904.296537:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324046976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788863904.296647:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863904.296719:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc8a2d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788863904.298914:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324046976 00000100:00100000:3.0:1788863904.298939:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324046976 00000100:00100000:3.0:1788863904.299049:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788863904.299064:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bd286d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+17:14316:x1875759324046976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788863904.299093:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863904.299125:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bffc17e00/0x744cd7666bbbbf56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbf4f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863904.299174:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bffc17e00/0x744cd7666bbbbf56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbf4f expref: 18 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863904.299192:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bffc17e00/0x744cd7666bbbbf56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbf4f expref: 18 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863904.299204:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17e00, rc 0) 00000100:00100000:3.0:1788863904.299352:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bd286d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98ce9f4a-6069-439b-828d-fac2605e9de4+18:14316:x1875759324046976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 292us (2705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863904.299361:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788863904.299893:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324046976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863904.299926:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bfeb64800/0x744cd7666bbbbf4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbf56 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863904.299938:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bfeb64800/0x744cd7666bbbbf4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbf56 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863904.300086:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324047104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.300136:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863904.300182:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd03a6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788863904.306905:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324047104 00000100:00100000:0.0:1788863904.306933:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324047104 00000100:00100000:0.0:1788863904.307054:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788863904.307068:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+18:14316:x1875759324047104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863904.307623:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+18:14316:x1875759324047104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 555us (7483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863904.307633:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788863904.307938:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324047104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.308021:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324047232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.308080:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863904.308104:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd03a6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788863904.308119:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324047232 00000100:00100000:2.0:1788863904.308123:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324047232 00000100:00100000:2.0:1788863904.308152:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788863904.308158:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+18:14316:x1875759324047232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.308375:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+18:14316:x1875759324047232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863904.308382:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788863904.308433:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324047232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788863904.309306:0:16479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788863904.309421:0:14316:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788863904.309450:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788863904.309466:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bfeb64800/0x744cd7666bbbbf4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbf56 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863904.309483:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bfeb64800/0x744cd7666bbbbf4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbf56 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863904.309509:0:14316:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788863904.309513:0:14316:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e8bfb3af800 from 10 10000000:01000000:2.0:1788863904.309516:0:14316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788863904.309563:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bee554400/0x744cd7666bbbbf5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863904.309572:0:14316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8e8bee554400/0x744cd7666bbbbf5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863904.309584:0:14316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8e8bee554400/0x744cd7666bbbbf5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863904.309609:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324047360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.309662:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863904.309694:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd03a6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788863904.309711:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324047360 00000100:00100000:2.0:1788863904.309717:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324047360 00000100:00100000:2.0:1788863904.309751:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788863904.309758:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+18:14316:x1875759324047360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863904.309770:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863904.309784:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bee555800/0x744cd7666bbbbf64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x744cd7666bbbbf5d expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863904.309813:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bee555800/0x744cd7666bbbbf64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x744cd7666bbbbf5d expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863904.309826:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bee555800/0x744cd7666bbbbf64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x744cd7666bbbbf5d expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863904.309848:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555800, rc 0) 00000100:00100000:2.0:1788863904.309904:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:14316:x1875759324047360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863904.309910:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788863904.309951:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324047360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788863904.309967:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8e8bee554400/0x744cd7666bbbbf5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbf64 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863904.309977:0:14316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8e8bee554400/0x744cd7666bbbbf5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x744cd7666bbbbf64 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863904.310021:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324047488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.310043:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863904.310058:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd03a6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788863904.310068:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324047488 00000100:00100000:2.0:1788863904.310071:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324047488 00000100:00100000:2.0:1788863904.310088:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788863904.310093:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:14316:x1875759324047488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.310394:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:14316:x1875759324047488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863904.310402:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788863904.310434:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324047488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.310468:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324047616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.310510:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863904.310532:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd03a6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788863904.310544:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324047616 00000100:00100000:2.0:1788863904.310549:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324047616 00000100:00100000:2.0:1788863904.310569:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788863904.310575:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:14316:x1875759324047616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.324348:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:14316:x1875759324047616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 13740us (13804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863904.324379:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788863904.324436:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98ce9f4a-6069-439b-828d-fac2605e9de4:14316:1875759324047616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788863904.328595:0:16481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:0.0:1788863904.328772:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863904.328831:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298887424 00000100:00100000:0.0:1788863904.328961:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298887424 00000100:00100000:0.0:1788863904.329039:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:0.0:1788863904.329051:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+11:13739:x1875759298887424:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788863904.329082:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863904.329115:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bfeb64200/0x744cd7666bbbbf6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3312e5 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863904.329166:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bfeb64200/0x744cd7666bbbbf6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312e5 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863904.329210:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bfeb64200/0x744cd7666bbbbf6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312e5 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863904.329224:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfeb64200, rc 0) 00000020:01000000:3.0:1788863904.329863:0:14316:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788863904.329911:0:14316:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788863904.329924:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8e8bee554400/0x744cd7666bbbbf5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbf64 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863904.329945:0:14316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8e8bee554400/0x744cd7666bbbbf5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x744cd7666bbbbf64 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863904.330217:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+12:13739:x1875759298887424:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 1161us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863904.330229:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:3.0:1788863904.353223:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863904.353308:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298887552 00000100:00100000:2.0:1788863904.353333:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298887552 00000100:00100000:2.0:1788863904.353417:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:2.0:1788863904.353431:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+12:13739:x1875759298887552:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788863904.353841:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+12:13739:x1875759298887552:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 411us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863904.353876:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:2.0:1788863904.356111:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863904.356198:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298887680 00000100:00100000:3.0:1788863904.356214:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298887680 00000100:00100000:3.0:1788863904.356299:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:3.0:1788863904.356315:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+12:13739:x1875759298887680:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788863904.357065:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+12:13739:x1875759298887680:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 743us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863904.357081:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:3.0:1788863904.364999:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863904.365574:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298887808 00000100:00100000:1.0:1788863904.365594:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298887808 00000100:00100000:1.0:1788863904.365679:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:1.0:1788863904.365694:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+12:13739:x1875759298887808:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788863904.365725:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863904.365755:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbf72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3312ec expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863904.366135:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbf72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312ec expref: 13 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863904.366177:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8bf4e7ae00/0x744cd7666bbbbf72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312ec expref: 13 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863904.366191:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7ae00, rc 0) 00000100:00100000:1.0:1788863904.366627:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757561f2-9678-4319-9860-6d7710ce5d8a+13:13739:x1875759298887808:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 934us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863904.366638:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:3.0:1788863904.371580:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863904.371808:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298887936 00000100:00100000:0.0:1788863904.371824:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298887936 00000100:00100000:0.0:1788863904.371966:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:0.0:1788863904.371982:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+13:13739:x1875759298887936:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788863904.372676:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+13:13739:x1875759298887936:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 682us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863904.372690:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:1.0:1788863904.377585:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863904.379614:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298888064 00000100:00100000:0.0:1788863904.379642:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298888064 00000100:00100000:0.0:1788863904.380011:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:0.0:1788863904.380026:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+13:13739:x1875759298888064:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788863904.380429:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757561f2-9678-4319-9860-6d7710ce5d8a+13:13739:x1875759298888064:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 404us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863904.380439:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:1.0:1788863904.854160:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324047872:0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.854294:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863904.854368:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788863904.854387:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324047744:0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.854420:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863904.854440:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324048256:0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.854466:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863904.854490:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324048000:0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.854512:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863904.854530:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863904.854535:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bee551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324048128:0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.854556:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863904.854588:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324047872 00000100:00100000:1.0:1788863904.854596:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324047872 00000100:00100000:1.0:1788863904.854647:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324047744 00000100:00100000:1.0:1788863904.854650:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324047744 00000100:00100000:1.0:1788863904.854670:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863904.854679:0:15003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324047872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.854745:0:15003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324047872:12345-0@lo:400:kworker.0 Request processed in 68us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863904.854753:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788863904.854769:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788863904.854774:0:15003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324047744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.854799:0:15003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324047744:12345-0@lo:400:kworker.0 Request processed in 25us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863904.854804:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788863904.854824:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324048256 00000100:00100000:1.0:1788863904.854828:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324048256 00000100:00100000:1.0:1788863904.854847:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324048000 00000100:00100000:1.0:1788863904.854871:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324048000 00000100:00100000:1.0:1788863904.854884:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324048128 00000100:00100000:1.0:1788863904.854886:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324048128 00000100:00100000:1.0:1788863904.854897:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788863904.854902:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324048256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.854929:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324048256:12345-0@lo:400:kworker.0 Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863904.854935:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788863904.854946:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788863904.854951:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324048000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.855008:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875759324048000:12345-0@lo:400:kworker.0 Request processed in 56us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863904.855014:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788863904.855025:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788863904.855030:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324048128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.855065:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875759324048128:12345-0@lo:400:kworker.0 Request processed in 34us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863904.855071:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788863904.855093:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863904.855098:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863904.855100:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863904.855131:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875759324048128:0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.855140:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875759324048000:0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.855166:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324047744:0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.855176:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324048256:0@lo:400:kworker.0 00000100:00100000:1.0:1788863904.855184:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bee552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324047872:0@lo:400:kworker.0 00000100:00100000:2.0:1788863904.860109:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863904.860138:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bca963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324048384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863904.860427:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863904.860918:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324048384 00000100:00100000:3.0:1788863904.860932:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324048384 00000100:00100000:3.0:1788863904.861099:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788863904.861113:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324048384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863904.861161:0:15007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863904.861249:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875759324048384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863904.861257:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788863904.861349:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bca963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875759324048384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788863904.928237:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863905.091565:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863905.091604:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298888192 00000100:00100000:1.0:1788863905.091618:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298888192 00000100:00100000:1.0:1788863905.092152:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:1.0:1788863905.092166:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+13:2351:x1875759298888192:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863905.092295:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+13:2351:x1875759298888192:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 131us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863905.092305:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:1.0:1788863905.096920:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863905.097142:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863905.097169:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863905.097193:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863905.097336:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298888448 00000100:00100000:2.0:1788863905.097354:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298888448 00000100:00100000:2.0:1788863905.097436:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298888960 00000100:00100000:2.0:1788863905.097440:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298888960 00000100:00100000:2.0:1788863905.097469:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1788863905.097484:0:15003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2351:x1875759298888448:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788863905.097618:0:15003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2351:x1875759298888448:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 137us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863905.097980:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863905.098001:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863905.098021:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298888704 00000100:00100000:1.0:1788863905.098028:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298888704 00000100:00100000:1.0:1788863905.098074:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298888320 00000100:00100000:1.0:1788863905.098078:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298888320 00000100:00100000:1.0:1788863905.098099:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1788863905.098108:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+6:2351:x1875759298888704:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863905.098155:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+6:2351:x1875759298888704:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 48us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863905.098163:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1788863905.098186:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:1.0:1788863905.098192:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:2350:x1875759298888320:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863905.098302:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:2350:x1875759298888320:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 109us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863905.098320:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:1.0:1788863905.098341:0:15006:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298888576 00000100:00100000:1.0:1788863905.098345:0:15006:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298888576 00000100:00100000:1.0:1788863905.098363:0:15006:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298888832 00000100:00100000:1.0:1788863905.098365:0:15006:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298888832 00000100:00100000:1.0:1788863905.098381:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1788863905.098388:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f576e463-13c4-424a-a092-65e3da1791c5+5:2351:x1875759298888960:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863905.098454:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f576e463-13c4-424a-a092-65e3da1791c5+5:2351:x1875759298888960:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 65us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863905.098462:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1788863905.098480:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1788863905.098494:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2350:x1875759298888576:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863905.098525:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2350:x1875759298888576:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863905.098531:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1788863905.098543:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:1.0:1788863905.098549:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f576e463-13c4-424a-a092-65e3da1791c5+5:2350:x1875759298888832:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863905.098575:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f576e463-13c4-424a-a092-65e3da1791c5+5:2350:x1875759298888832:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863905.098582:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00080000:1.0:1788863905.098600:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863905.098607:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863905.098609:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863905.098805:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:1.0:1788863905.881992:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bffcfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324048512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863905.882098:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863905.883768:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324048512 00000100:00100000:2.0:1788863905.883785:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324048512 00000100:00100000:2.0:1788863905.883887:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863905.883899:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324048512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863905.883952:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788863905.884054:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324048512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863905.884062:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788863905.885509:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bffcfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324048512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788863905.948838:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788863906.326559:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788863906.913235:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863906.913412:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298889088 00000100:00100000:3.0:1788863906.913430:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298889088 00000100:00100000:3.0:1788863906.913534:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1788863906.913546:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:14398:x1875759298889088:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788863906.913593:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863906.913910:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbf79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3312f3 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.914011:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbf80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.914030:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbf80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.914049:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbf80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.914067:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16800/0x744cd7666bbbbf87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.914074:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16800/0x744cd7666bbbbf87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.914081:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16800/0x744cd7666bbbbf87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915011:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16200/0x744cd7666bbbbf8e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915026:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16200/0x744cd7666bbbbf8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915035:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16200/0x744cd7666bbbbf8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863906.915069:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788863906.915082:0:14319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863906.915138:0:14319:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16200/0x744cd7666bbbbf8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915151:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbf80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915158:0:14319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbf80 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915166:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbf80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915173:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc17c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863906.915178:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbf80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915187:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbf80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915200:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:3.0:1788863906.915204:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863906.915210:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbf80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915217:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbf80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915230:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16800/0x744cd7666bbbbf87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915236:0:14319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16800/0x744cd7666bbbbf87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915253:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16800/0x744cd7666bbbbf87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915259:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863906.915263:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16800/0x744cd7666bbbbf87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915270:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16800/0x744cd7666bbbbf87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915290:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e8bc3015500) 00010000:00010000:3.0:1788863906.915292:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863906.915295:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16800/0x744cd7666bbbbf87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915301:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16800/0x744cd7666bbbbf87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915345:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbf79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312f3 expref: 8 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.915360:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16200/0x744cd7666bbbbf8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312f3 expref: 7 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863906.916101:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8bc3015c00) 00010000:00010000:3.0:1788863906.916104:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863906.916106:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc16200, rc 0) 00000100:00100000:3.0:1788863906.916213:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:14398:x1875759298889088:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2666us (2992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863906.916234:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1788863906.920003:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863906.921014:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298889344 00000100:00100000:2.0:1788863906.921031:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298889344 00000100:00100000:2.0:1788863906.921127:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1788863906.921139:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:14398:x1875759298889344:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863906.921169:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863906.921199:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbbf95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd3312fa expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.921322:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbf9c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.921340:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbf9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.921356:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbf9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.922066:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfa3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.922094:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.922166:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.923643:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbbfaa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.923660:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbbfaa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.923670:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbbfaa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863906.923683:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788863906.924004:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbf9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924013:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbf9c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924022:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbf9c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924027:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863906.924031:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbf9c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924049:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbf9c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924064:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8bc3015c00) 00010000:00010000:2.0:1788863906.924067:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863906.924072:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbf9c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924077:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbf9c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924092:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924286:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfa3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924295:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfa3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924300:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863906.924303:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfa3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924371:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfa3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924382:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e8bc9330100) 00010000:00010000:2.0:1788863906.924384:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863906.924389:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfa3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.924404:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfa3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.926591:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbbf95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312fa expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.926618:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554e00/0x744cd7666bbbbfaa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312fa expref: 9 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863906.926628:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bc9330e00) 00010000:00010000:2.0:1788863906.926631:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863906.926634:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554e00, rc 0) 00000100:00100000:2.0:1788863906.926718:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:14398:x1875759298889344:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 5580us (6734us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788863906.926727:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1788863906.939033:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863906.943451:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298889472 00000100:00100000:3.0:1788863906.943479:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298889472 00000100:00100000:3.0:1788863906.943589:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1788863906.943602:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:14398:x1875759298889472:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788863906.943801:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:14398:x1875759298889472:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 201us (4780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863906.943810:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00010000:00010000:3.0:1788863906.969188:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863907.005060:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863907.013037:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298889600 00000100:00100000:2.0:1788863907.013061:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298889600 00000100:00100000:2.0:1788863907.014210:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1788863907.014230:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:14404:x1875759298889600:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863907.014255:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863907.014291:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbbfb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331301 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014373:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014409:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014421:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014438:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbfc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014445:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbfc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014451:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbfc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014669:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014677:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfbf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014684:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014691:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863907.014695:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014715:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014729:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:2.0:1788863907.014738:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863907.014744:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014751:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbbfbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014765:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbfc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014771:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbfc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014778:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbfc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014784:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863907.014787:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbfc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014793:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbfc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014800:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863907.014803:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863907.014806:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbfc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014812:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbfc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014846:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbbfb8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331301 expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014911:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:2.0:1788863907.014913:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863907.014918:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbbfb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331301 expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.014927:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555400, rc 0) 00000100:00100000:2.0:1788863907.015003:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:14404:x1875759298889600:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 780us (9961us total) trans 0 rc 301/301 00000100:00100000:2.0:1788863907.015011:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1788863907.021017:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863907.021138:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298889728 00000100:00100000:0.0:1788863907.021150:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298889728 00000100:00100000:0.0:1788863907.021209:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:0.0:1788863907.021236:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:14404:x1875759298889728:12345-192.168.204.51@tcp:700:lfs.0 00000100:00100000:0.0:1788863907.021454:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:14404:x1875759298889728:12345-192.168.204.51@tcp:700:lfs.0 Request processed in 219us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863907.021464:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1788863907.023827:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863907.024039:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298889984 00000100:00100000:0.0:1788863907.024050:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298889984 00000100:00100000:0.0:1788863907.024137:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1788863907.024151:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:14404:x1875759298889984:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:0.0:1788863907.024239:0:14320:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863907.024290:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbbefb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33127c expref: 9 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.024326:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:0.0:1788863907.024333:0:14320:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863907.024595:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.024613:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbbf33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312de expref: 5 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.024623:0:14320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.024664:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbbf33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312de expref: 5 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.024681:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbbf33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312de expref: 5 pid: 14319 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863907.024722:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14320:1875759324048640:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863907.024827:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bd5628840 going to sleep for 11 seconds 00000100:00080000:1.0:1788863907.026903:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863907.029961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863907.030147:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14320:1875759324048640:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863907.030179:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863907.030330:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298890112 00000100:00100000:1.0:1788863907.030339:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298890112 00010000:00010000:1.0:1788863907.030402:0:14305:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbbf33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312de expref: 6 pid: 14319 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863907.030445:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788863907.030457:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f576e463-13c4-424a-a092-65e3da1791c5+6:2350:x1875759298890112:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863907.030489:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863907.030498:0:14305:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbbf33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312de expref: 6 pid: 14319 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.030512:0:14305:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbbf33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312de expref: 6 pid: 14319 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.030540:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbbf33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd3312de expref: 6 pid: 14319 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.030560:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:1.0:1788863907.030564:0:14305:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.030575:0:14305:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.030582:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.030605:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863907.030664:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f576e463-13c4-424a-a092-65e3da1791c5+5:2350:x1875759298890112:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 209us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863907.030671:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00080000:2.0:1788863907.030925:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788863907.031393:0:14320:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.031405:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.031441:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbfd4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.031451:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbfd4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.031462:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbfd4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863907.040303:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788863907.040826:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.040839:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.040848:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.041176:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfeb65200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:3.0:1788863907.041182:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.041191:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.041209:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:3.0:1788863907.041212:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863907.041218:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.041224:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbbfcd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788863907.041254:0:14320:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e7ec34f reply state 00000000a6853071 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbfd4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863907.041265:0:14320:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788863907.042482:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+10:14404:x1875759298889984:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 18316us (18647us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788863907.042493:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00010000:00010000:2.0:1788863907.053539:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbfd4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.053562:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbfd4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.053571:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbfd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.053577:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863907.053583:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbfd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.053591:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbfd4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.053608:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8bc3015500) 00010000:00010000:2.0:1788863907.053623:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863907.053647:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbfd4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.053654:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16600/0x744cd7666bbbbfd4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863907.263580:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863907.264226:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298890240 00000100:00100000:3.0:1788863907.264264:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298890240 00000100:00100000:3.0:1788863907.264389:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:3.0:1788863907.264406:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:14412:x1875759298890240:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:3.0:1788863907.264458:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788863907.264504:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16800/0x744cd7666bbbbfdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331308 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.264884:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbfe2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.264903:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbfe2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.264919:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbfe2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788863907.264972:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788863907.264977:0:14319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788863907.265031:0:14319:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbfe2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.265066:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc16800/0x744cd7666bbbbfdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331308 expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.265456:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bffc17c00/0x744cd7666bbbbfe2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331308 expref: 10 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.265471:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015e00) 00010000:00010000:3.0:1788863907.265473:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863907.265478:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bffc17c00, rc 0) 00000100:00100000:3.0:1788863907.266083:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+10:14412:x1875759298890240:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 1677us (2522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863907.266105:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:3.0:1788863907.290439:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863907.290771:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298890368 00000100:00100000:0.0:1788863907.290789:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298890368 00000100:00100000:0.0:1788863907.290945:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:0.0:1788863907.290959:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f576e463-13c4-424a-a092-65e3da1791c5+5:14413:x1875759298890368:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863907.291530:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863907.291569:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65600/0x744cd7666bbbbfe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33130f expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.292538:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65c00/0x744cd7666bbbbff0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.292564:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65c00/0x744cd7666bbbbff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.292580:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65c00/0x744cd7666bbbbff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863907.292748:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788863907.292754:0:14320:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788863907.292786:0:14320:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65c00/0x744cd7666bbbbff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.292885:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65600/0x744cd7666bbbbfe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33130f expref: 7 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.292921:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65c00/0x744cd7666bbbbff0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33130f expref: 6 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.292931:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015e00) 00010000:00010000:0.0:1788863907.292934:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788863907.292942:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfeb65c00, rc 0) 00000100:00100000:0.0:1788863907.293120:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f576e463-13c4-424a-a092-65e3da1791c5+6:14413:x1875759298890368:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 2162us (2782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863907.293131:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:0.0:1788863907.296534:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863907.296774:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298890496 00000100:00100000:3.0:1788863907.296790:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298890496 00000100:00100000:2.0:1788863907.297693:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1788863907.297722:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+6:14413:x1875759298890496:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788863907.297753:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863907.297787:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbbff7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331316 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.297910:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbffe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.298067:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbffe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.298084:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbffe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.298104:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc005 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.298112:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.298119:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300098:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc00c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300149:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc00c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300165:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc00c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788863907.300219:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788863907.300224:0:14319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788863907.300251:0:14319:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc00c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300278:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbffe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300286:0:14319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbffe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300293:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbffe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300300:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863907.300304:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbffe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300312:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbffe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300325:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015e00) 00010000:00010000:2.0:1788863907.300329:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863907.300334:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300354:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbbffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300376:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300383:0:14319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300389:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300394:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863907.300397:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300403:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc005 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300412:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863907.300415:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863907.300418:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc005 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300424:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc005 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300478:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbbff7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331316 expref: 8 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300518:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc00c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331316 expref: 7 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.300526:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8bc9330c00) 00010000:00010000:2.0:1788863907.300528:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863907.300530:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee555e00, rc 0) 00000100:00100000:2.0:1788863907.300623:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+7:14413:x1875759298890496:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 2916us (4106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863907.300632:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:1.0:1788863907.308176:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863907.309092:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298890752 00000100:00100000:0.0:1788863907.309107:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298890752 00000100:00100000:0.0:1788863907.309168:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:0.0:1788863907.309179:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f576e463-13c4-424a-a092-65e3da1791c5+7:14413:x1875759298890752:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863907.309204:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863907.309228:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65600/0x744cd7666bbbc013 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33131d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863907.309336:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788863907.312101:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65600/0x744cd7666bbbc013 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33131d expref: 9 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.312126:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015e00) 00010000:00010000:0.0:1788863907.312152:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863907.312159:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65600/0x744cd7666bbbc013 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33131d expref: 9 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.312186:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfeb65600, rc 0) 00000100:00100000:0.0:1788863907.312362:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f576e463-13c4-424a-a092-65e3da1791c5+8:14413:x1875759298890752:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 3182us (4196us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788863907.312374:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:3.0:1788863907.327842:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863907.327981:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298891008 00000100:00100000:2.0:1788863907.327995:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298891008 00000100:00100000:2.0:1788863907.328058:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:2.0:1788863907.328068:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+8:14413:x1875759298891008:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:2.0:1788863907.328137:0:14319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863907.328167:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc00c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331316 expref: 8 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.328191:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8bc9330c00) 00010000:00010000:2.0:1788863907.328205:0:14319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788863907.328236:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc021 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.328248:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc021 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.328258:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc021 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788863907.328521:0:14319:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091c92b94 reply state 0000000075d68e43 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc021 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863907.328531:0:14319:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788863907.328539:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788863907.328622:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+9:14413:x1875759298891008:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 554us (806us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788863907.328629:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:3.0:1788863907.331326:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863907.331417:0:14321:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298891264 00000100:00100000:0.0:1788863907.331429:0:14321:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298891264 00000100:00100000:0.0:1788863907.331500:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:0.0:1788863907.331522:0:14321:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f576e463-13c4-424a-a092-65e3da1791c5+9:14413:x1875759298891264:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788863907.331805:0:14321:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f576e463-13c4-424a-a092-65e3da1791c5+10:14413:x1875759298891264:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 285us (487us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788863907.331822:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00010000:00010000:2.0:1788863907.334062:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc021 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.334085:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc021 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.334094:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc021 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.334101:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863907.334107:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc021 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.334117:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc021 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.334147:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8bc9330100) 00010000:00010000:2.0:1788863907.334150:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788863907.334156:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc021 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.334165:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc021 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788863907.351404:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788863907.355186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863907.355500:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298891520 00000100:00100000:0.0:1788863907.355515:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298891520 00000100:00100000:0.0:1788863907.355601:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1788863907.355613:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f576e463-13c4-424a-a092-65e3da1791c5+9:14413:x1875759298891520:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788863907.355648:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863907.355683:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65600/0x744cd7666bbbc028 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331324 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.355798:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64c00/0x744cd7666bbbc02f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.355819:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64c00/0x744cd7666bbbc02f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.355894:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64c00/0x744cd7666bbbc02f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.355917:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65400/0x744cd7666bbbc036 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.355925:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65400/0x744cd7666bbbc036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.355932:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65400/0x744cd7666bbbc036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863907.364065:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788863907.364285:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64c00/0x744cd7666bbbc02f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364299:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64c00/0x744cd7666bbbc02f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364307:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64c00/0x744cd7666bbbc02f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364314:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfeb64c00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863907.364319:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64c00/0x744cd7666bbbc02f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364328:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64c00/0x744cd7666bbbc02f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364347:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015e00) 00010000:00010000:0.0:1788863907.364350:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863907.364372:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64c00/0x744cd7666bbbc02f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364380:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64c00/0x744cd7666bbbc02f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364409:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65400/0x744cd7666bbbc036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364417:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65400/0x744cd7666bbbc036 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364424:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65400/0x744cd7666bbbc036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364429:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfeb65400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863907.364433:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65400/0x744cd7666bbbc036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364439:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65400/0x744cd7666bbbc036 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364448:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8bc5119200) 00010000:00010000:0.0:1788863907.364450:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863907.364453:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65400/0x744cd7666bbbc036 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364460:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65400/0x744cd7666bbbc036 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364522:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65600/0x744cd7666bbbc028 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331324 expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364563:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015e00) 00010000:00010000:0.0:1788863907.364566:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863907.364570:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65600/0x744cd7666bbbc028 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331324 expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.364582:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfeb65600, rc 0) 00000100:00100000:0.0:1788863907.364679:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f576e463-13c4-424a-a092-65e3da1791c5+10:14413:x1875759298891520:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 9067us (9501us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788863907.364689:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:3.0:1788863907.371195:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863907.373604:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298891648 00000100:00100000:1.0:1788863907.373636:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298891648 00000100:00100000:1.0:1788863907.373737:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:1.0:1788863907.373749:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f576e463-13c4-424a-a092-65e3da1791c5+10:14413:x1875759298891648:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863907.373781:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863907.373810:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc044 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33132b expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.373932:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc04b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.373948:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc04b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.373963:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc04b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863907.373989:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788863907.373993:0:14318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788863907.374013:0:14318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc04b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.374039:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc044 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33132b expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.374058:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc04b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33132b expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.374068:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8bd20dd600) 00010000:00010000:1.0:1788863907.374071:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788863907.374075:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a400, rc 0) 00000100:00100000:1.0:1788863907.374142:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f576e463-13c4-424a-a092-65e3da1791c5+11:14413:x1875759298891648:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 395us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863907.374155:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:3.0:1788863907.378647:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863907.378730:0:14321:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298891776 00000100:00100000:0.0:1788863907.378743:0:14321:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298891776 00000100:00100000:0.0:1788863907.378945:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1788863907.378957:0:14321:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f576e463-13c4-424a-a092-65e3da1791c5+11:14413:x1875759298891776:12345-192.168.204.51@tcp:37:lfs.0 00000100:00100000:2.0:1788863907.388998:0:14321:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f576e463-13c4-424a-a092-65e3da1791c5+11:14413:x1875759298891776:12345-192.168.204.51@tcp:37:lfs.0 Request processed in 10021us (10346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863907.389023:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:3.0:1788863907.396367:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863907.396581:0:14322:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298892032 00000100:00100000:1.0:1788863907.396595:0:14322:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298892032 00000100:00100000:1.0:1788863907.396669:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1788863907.396681:0:14322:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda52850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f576e463-13c4-424a-a092-65e3da1791c5+11:14413:x1875759298892032:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788863907.396947:0:14322:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda52850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f576e463-13c4-424a-a092-65e3da1791c5+12:14413:x1875759298892032:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 268us (597us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788863907.396955:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1788863907.443048:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863907.443464:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298892160 00000100:00100000:1.0:1788863907.443477:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298892160 00000100:00100000:1.0:1788863907.443705:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:1.0:1788863907.443722:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+10:14419:x1875759298892160:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788863907.443750:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863907.443879:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc052 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331332 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.443957:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc059 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444106:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc059 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444240:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc059 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444259:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc060 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444295:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc060 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444302:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc060 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444647:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbc067 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444657:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbc067 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444665:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbc067 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863907.444694:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788863907.444698:0:14320:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788863907.444735:0:14320:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbc067 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444747:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc059 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444754:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc059 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444761:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc059 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444767:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ba00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863907.444782:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc059 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444797:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc059 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444810:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015e00) 00010000:00010000:1.0:1788863907.444814:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863907.444820:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc059 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444827:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc059 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444839:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc060 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444846:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc060 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444884:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc060 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444890:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7b600 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863907.444894:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc060 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444901:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc060 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444909:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8bd20dd200) 00010000:00010000:1.0:1788863907.444912:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863907.444915:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc060 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444931:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc060 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.444988:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc052 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331332 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.445005:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ac00/0x744cd7666bbbc067 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331332 expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.445013:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8bd20dd600) 00010000:00010000:1.0:1788863907.445015:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788863907.445019:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7ac00, rc 0) 00000100:00100000:1.0:1788863907.445098:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+11:14419:x1875759298892160:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1380us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863907.445107:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000001:00080000:3.0:1788863907.448924:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1788863907.448952:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1788863907.448964:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000001:00080000:3.0:1788863907.448970:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000100:00100000:0.0:1788863907.450767:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863907.450825:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298892416 00000100:00100000:2.0:1788863907.450836:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298892416 00000100:00100000:2.0:1788863907.451677:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:2.0:1788863907.451693:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:14419:x1875759298892416:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788863907.451716:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863907.451740:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc06e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331339 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.452124:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.452141:0:14319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc04b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33132b expref: 6 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.452150:0:14319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.452193:0:14319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc04b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33132b expref: 6 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.452208:0:14319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc04b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33132b expref: 6 pid: 14318 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863907.452222:0:14319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14319:1875759324048768:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863907.452393:0:14319:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33c3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788863907.457049:0:14319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14319:1875759324048768:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863907.457086:0:14319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863907.457535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863907.457976:0:16437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298892544 00000100:00100000:3.0:1788863907.457985:0:16437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298892544 00010000:00010000:3.0:1788863907.458031:0:16437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc04b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33132b expref: 7 pid: 14318 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863907.458122:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1788863907.458150:0:16437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f576e463-13c4-424a-a092-65e3da1791c5+7:2350:x1875759298892544:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863907.458169:0:16437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863907.458184:0:16437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc04b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33132b expref: 7 pid: 14318 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.458220:0:16437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc04b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33132b expref: 7 pid: 14318 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.458250:0:16437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc04b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33132b expref: 7 pid: 14318 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.458280:0:16437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8bd20dd600) 00010000:00010000:3.0:1788863907.458286:0:16437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.458305:0:16437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.458314:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.458352:0:16437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863907.458417:0:16437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f576e463-13c4-424a-a092-65e3da1791c5+6:2350:x1875759298892544:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 277us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863907.458432:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00010000:00010000:1.0:1788863907.458538:0:14319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.458550:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.458597:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc07c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.458607:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc07c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.458615:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc07c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.459844:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc083 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.460007:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc083 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.460019:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc083 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863907.460032:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788863907.460068:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.460076:0:14319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.460084:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.460089:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863907.460094:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.460101:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.460112:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8bd20dd600) 00010000:00010000:1.0:1788863907.460116:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863907.460120:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.460139:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc075 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788863907.460153:0:14319:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006a0067d reply state 00000000c59cac8f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc07c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863907.460163:0:14319:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788863907.460208:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc06e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331339 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.460225:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc083 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331339 expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.460233:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:1.0:1788863907.460235:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788863907.460238:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b600, rc 0) 00000100:00100000:1.0:1788863907.460323:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+12:14419:x1875759298892416:12345-192.168.204.51@tcp:101:bash.0 Request processed in 8634us (9565us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788863907.460332:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00010000:00010000:2.0:1788863907.462785:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc07c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.462806:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc07c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.462814:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc07c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.462821:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863907.462825:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc07c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.462833:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc07c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.464705:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e8bd20dd200) 00010000:00010000:2.0:1788863907.464715:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863907.464725:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc07c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863907.464736:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc07c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863907.480557:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863907.480907:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298892672 00000100:00100000:1.0:1788863907.480919:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298892672 00000100:00100000:1.0:1788863907.480976:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:1.0:1788863907.480986:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+11:14419:x1875759298892672:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788863907.481016:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863907.481040:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc091 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331340 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.481135:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.481149:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.481161:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863907.481202:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788863907.481206:0:14320:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788863907.481225:0:14320:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.481236:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.481276:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc091 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331340 expref: 13 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.481296:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331340 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.481305:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:1.0:1788863907.481307:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863907.481311:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a800, rc 0) 00000100:00100000:1.0:1788863907.481526:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+12:14419:x1875759298892672:12345-192.168.204.51@tcp:101:bash.0 Request processed in 540us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863907.481534:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:0.0:1788863907.490319:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863907.490405:0:14322:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298892928 00000100:00100000:1.0:1788863907.490419:0:14322:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298892928 00000100:00100000:1.0:1788863907.490501:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1788863907.490516:0:14322:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+12:14419:x1875759298892928:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:1.0:1788863907.491040:0:14322:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+13:14419:x1875759298892928:12345-192.168.204.51@tcp:35:bash.0 Request processed in 526us (731us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788863907.491049:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1788863907.608213:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863907.608365:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298893184 00000100:00100000:1.0:1788863907.608380:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298893184 00000100:00100000:1.0:1788863907.608470:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:1.0:1788863907.608484:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+13:14429:x1875759298893184:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863907.608524:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863907.608556:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc09f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331347 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863907.609781:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788863907.610171:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc09f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331347 expref: 15 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.610196:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8bc3015e00) 00010000:00010000:1.0:1788863907.610200:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863907.610206:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc09f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331347 expref: 15 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.610289:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7ba00, rc 0) 00000100:00100000:1.0:1788863907.610403:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+14:14429:x1875759298893184:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1920us (2206us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788863907.610448:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:0.0:1788863907.612790:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863907.612970:0:14322:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298893440 00000100:00100000:1.0:1788863907.612985:0:14322:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298893440 00000100:00100000:1.0:1788863907.613054:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1788863907.613067:0:14322:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+14:14429:x1875759298893440:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788863907.613406:0:14322:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+15:14429:x1875759298893440:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 340us (634us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788863907.613415:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1788863907.648789:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863907.649136:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298893696 00000100:00100000:1.0:1788863907.649150:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298893696 00000100:00100000:1.0:1788863907.649253:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:1.0:1788863907.649280:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+15:14432:x1875759298893696:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788863907.649310:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863907.649338:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33134e expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.649478:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc0b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.649494:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.649523:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863907.649536:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788863907.649719:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33134e expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.649759:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33134e expref: 17 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.649771:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:1.0:1788863907.649774:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863907.649778:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a000, rc 0) 00000100:00100000:1.0:1788863907.649982:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+17:14432:x1875759298893696:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 703us (1214us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788863907.649990:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:2.0:1788863907.658438:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863907.658838:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863907.659017:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298893952 00000100:00100000:0.0:1788863907.659032:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298893952 00000100:00100000:0.0:1788863907.659356:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:0.0:1788863907.659375:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+17:2353:x1875759298893952:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863907.659398:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863907.659439:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc0b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33134e expref: 17 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.659480:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:0.0:1788863907.659488:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863907.660006:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+16:2353:x1875759298893952:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 631us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863907.660017:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1788863907.660784:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298893824 00000100:00100000:1.0:1788863907.660800:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298893824 00000100:00100000:1.0:1788863907.660890:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:1.0:1788863907.661041:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+16:14432:x1875759298893824:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:1.0:1788863907.661336:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.661364:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.661381:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.661421:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.661430:0:14319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.661463:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.661470:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ba00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863907.661477:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.661487:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.661503:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:1.0:1788863907.661507:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788863907.661515:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0c2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.661534:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863907.661656:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+16:14432:x1875759298893824:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 757us (3240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863907.661667:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:0.0:1788863907.671340:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863907.671552:0:14321:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298894208 00000100:00100000:2.0:1788863907.671570:0:14321:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298894208 00000100:00100000:2.0:1788863907.671666:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1788863907.671692:0:14321:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+16:14432:x1875759298894208:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788863907.672392:0:14321:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+17:14432:x1875759298894208:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 710us (1066us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788863907.672403:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1788863907.895998:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863907.896273:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298894464 00000100:00100000:1.0:1788863907.896288:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298894464 00000100:00100000:1.0:1788863907.896376:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:1.0:1788863907.896389:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+17:14463:x1875759298894464:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:1.0:1788863907.896421:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863907.896453:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331355 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.896626:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc0d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.896646:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.896665:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788863907.896679:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788863907.896954:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331355 expref: 20 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.897309:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331355 expref: 19 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863907.897324:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:1.0:1788863907.897328:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863907.897333:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a400, rc 0) 00000100:00100000:1.0:1788863907.897637:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+19:14463:x1875759298894464:12345-192.168.204.51@tcp:101:cat.0 Request processed in 1248us (1670us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788863907.897647:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:2.0:1788863907.907642:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863907.907755:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298894592 00000100:00100000:3.0:1788863907.907769:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298894592 00000100:00100000:3.0:1788863907.907885:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1788863907.907897:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+19:2350:x1875759298894592:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788863907.907918:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788863907.908085:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc0d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331355 expref: 19 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863907.908136:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:3.0:1788863907.908143:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788863907.908225:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+18:2350:x1875759298894592:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 329us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863907.908237:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:0.0:1788863907.910476:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863907.910595:0:14321:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298894848 00000100:00100000:2.0:1788863907.910612:0:14321:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298894848 00000100:00100000:2.0:1788863907.910751:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1788863907.910765:0:14321:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+18:14463:x1875759298894848:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:2.0:1788863907.911427:0:14321:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+19:14463:x1875759298894848:12345-192.168.204.51@tcp:35:cat.0 Request processed in 662us (962us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788863907.911436:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00010000:00010000:3.0:1788863907.991468:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863907.997774:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863907.998086:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298895104 00000100:00100000:0.0:1788863907.998105:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298895104 00000100:00100000:0.0:1788863907.998336:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:0.0:1788863907.998350:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+19:14469:x1875759298895104:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1788863907.998390:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863907.998423:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65000/0x744cd7666bbbc0de lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33135c expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.998587:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbc0e5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.998610:0:14318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc083 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331339 expref: 20 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.998620:0:14318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331340 expref: 20 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.998630:0:14318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbc0e5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.998713:0:14318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331340 expref: 20 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.998731:0:14318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331340 expref: 20 pid: 14320 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863907.998750:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14318:1875759324048896:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863907.998958:0:14318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc083 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331339 expref: 20 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863907.998969:0:14318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc083 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331339 expref: 20 pid: 14319 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863907.998979:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabde680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14318:1875759324049024:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863907.999006:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bf47b2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788863908.009352:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.009419:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863908.009590:0:14303:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298895232 00000100:00100000:3.0:1788863908.009608:0:14303:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298895232 00010000:00010000:3.0:1788863908.009673:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc083 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331339 expref: 21 pid: 14319 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863908.009766:0:14303:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298895360 00000100:00100000:3.0:1788863908.009770:0:14303:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298895360 00010000:00010000:3.0:1788863908.009787:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331340 expref: 22 pid: 14320 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863908.009880:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabde680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14318:1875759324049024:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788863908.009899:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14318:1875759324048896:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788863908.009940:0:14318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbc0e5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863908.010069:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1788863908.010084:0:16437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c62850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+22:2351:x1875759298895232:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863908.010110:0:16437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863908.010120:0:16437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc083 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331339 expref: 22 pid: 14319 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.010133:0:16437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc083 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331339 expref: 22 pid: 14319 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.010266:0:16437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc083 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331339 expref: 22 pid: 14319 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.010290:0:16437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:0.0:1788863908.010296:0:16437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbc0e5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.010306:0:16437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbc0e5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.010313:0:16437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863908.010407:0:16437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c62850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+21:2351:x1875759298895232:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 326us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.010415:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1788863908.010498:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1788863908.010506:0:16437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+20:2350:x1875759298895360:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863908.010516:0:16437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863908.010521:0:16437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331340 expref: 20 pid: 14320 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.010534:0:16437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331340 expref: 20 pid: 14320 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.010547:0:16437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc098 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331340 expref: 20 pid: 14320 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.010570:0:16437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:0.0:1788863908.010574:0:16437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbc0e5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.010584:0:16437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbc0e5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.010595:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbc0e5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.010626:0:16437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863908.010648:0:16437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+19:2350:x1875759298895360:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 142us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.010655:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00010000:00010000:0.0:1788863908.010680:0:14318:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbc0e5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.010688:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbc0e5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863908.010720:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788863908.011029:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65000/0x744cd7666bbbc0de lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33135c expref: 20 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.011059:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65200/0x744cd7666bbbc0e5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33135c expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.011069:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:0.0:1788863908.011078:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788863908.011081:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfeb65200, rc 0) 00000100:00100000:0.0:1788863908.011119:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+19:14469:x1875759298895104:12345-192.168.204.51@tcp:101:dd.0 Request processed in 12774us (13373us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788863908.011127:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:3.0:1788863908.024506:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863908.027928:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298895616 00000100:00100000:1.0:1788863908.027955:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298895616 00000100:00100000:1.0:1788863908.028055:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:1.0:1788863908.028070:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+19:14469:x1875759298895616:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:1.0:1788863908.029009:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0f3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.029041:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.029061:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863908.029404:0:14320:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788863908.029444:0:14320:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002852aa6b reply state 000000004b341ad3 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863908.029457:0:14320:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788863908.033618:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+22:14469:x1875759298895616:12345-192.168.204.51@tcp:36:dd.0 Request processed in 5517us (9095us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788863908.034298:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000020:00080000:1.0:1788863908.034313:0:14320:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788863908.041579:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.042934:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298895744 00000100:00100000:0.0:1788863908.042955:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298895744 00000100:00100000:0.0:1788863908.043068:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:0.0:1788863908.043096:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+22:14469:x1875759298895744:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1788863908.043140:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863908.043363:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbc0fa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331363 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.043466:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbc0fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331363 expref: 23 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.043487:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbc0fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331363 expref: 23 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.043515:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:0.0:1788863908.043519:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863908.043525:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfeb64600, rc 0) 00000100:00100000:0.0:1788863908.043647:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+23:14469:x1875759298895744:12345-192.168.204.51@tcp:101:dd.0 Request processed in 548us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.043656:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00010000:00010000:2.0:1788863908.051485:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.051511:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0f3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.051520:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.051528:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ba00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863908.051534:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.051569:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0f3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.051593:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:2.0:1788863908.054117:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863908.054135:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0f3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.054149:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc0f3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863908.077767:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863908.078471:0:16437:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298896000 00000100:00100000:1.0:1788863908.078491:0:16437:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298896000 00000100:00100000:1.0:1788863908.081295:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1788863908.081338:0:16437:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+22:14469:x1875759298896000:12345-192.168.204.51@tcp:103:dd.0 00010000:00010000:1.0:1788863908.081371:0:16437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863908.081429:0:16437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64600/0x744cd7666bbbc0fa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331363 expref: 22 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.081468:0:16437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:1.0:1788863908.081477:0:16437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863908.081901:0:16437:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+21:14469:x1875759298896000:12345-192.168.204.51@tcp:103:dd.0 Request processed in 281us (3847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863908.081912:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1788863908.086210:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.086441:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298896128 00000100:00100000:0.0:1788863908.086475:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298896128 00000100:00100000:0.0:1788863908.086564:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1788863908.086576:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+21:14469:x1875759298896128:12345-192.168.204.51@tcp:58:dd.0 00010000:00010000:0.0:1788863908.086768:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64000/0x744cd7666bbbc101 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.086793:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64000/0x744cd7666bbbc101 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.086809:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64000/0x744cd7666bbbc101 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788863908.093288:0:14320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788863908.093512:0:14320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788863908.093606:0:14320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788863908.094426:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+21:14469:x1875759298896128:12345-192.168.204.51@tcp:58:dd.0 Request processed in 7840us (8222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.094441:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:3.0:1788863908.098472:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863908.106616:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298896256 00000100:00100000:1.0:1788863908.106656:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298896256 00000100:00100000:1.0:1788863908.106782:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:1.0:1788863908.106796:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+21:14469:x1875759298896256:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:1.0:1788863908.106829:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863908.106885:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc108 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33136a expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.106980:0:14319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64000/0x744cd7666bbbc101 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.106994:0:14319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc108 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33136a expref: 22 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.107020:0:14319:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64000/0x744cd7666bbbc101 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.107037:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc108 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33136a expref: 22 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.107055:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:1.0:1788863908.107078:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788863908.107083:0:14319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc108 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33136a expref: 22 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.107092:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7a800, rc 0) 00000100:00100000:1.0:1788863908.107196:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+22:14469:x1875759298896256:12345-192.168.204.51@tcp:101:dd.0 Request processed in 402us (8746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863908.107204:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000040:00080000:1.0:1788863908.375226:0:14349:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788863908.375236:0:14349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788863908.375294:0:14349:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788863908.375301:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788863908.375460:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff135f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14349:1875759324049152:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788863908.375657:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bfbbd3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788863908.388105:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff135f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14349:1875759324049152:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788863908.390073:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.391576:0:14329:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298896384 00000100:00100000:0.0:1788863908.391597:0:14329:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298896384 00000100:00100000:0.0:1788863908.391684:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:0.0:1788863908.391699:0:14329:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+22:14470:x1875759298896384:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788863908.391811:0:14329:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+22:14470:x1875759298896384:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 Request processed in 114us (2197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.391818:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1788863908.400473:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.404174:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298896512 00000100:00100000:0.0:1788863908.404206:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298896512 00000100:00100000:0.0:1788863908.404420:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:0.0:1788863908.404436:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bffcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+22:14470:x1875759298896512:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788863908.404535:0:14320:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788863908.405135:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bffcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+22:14470:x1875759298896512:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 700us (4675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.405144:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:2.0:1788863908.415447:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.417206:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298896640 00000100:00100000:0.0:1788863908.417232:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298896640 00000100:00100000:0.0:1788863908.417339:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1788863908.417351:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+22:14470:x1875759298896640:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788863908.417463:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc10f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.417490:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc10f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.417507:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc10f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.417692:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc116 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.417718:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc116 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.417743:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc116 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.417780:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc11d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.417789:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc11d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.417814:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc11d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863908.417936:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788863908.417941:0:14318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788863908.417962:0:14318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc11d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419501:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc10f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419517:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc10f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419526:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc10f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419533:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfeb65a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863908.419539:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc10f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419548:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc10f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419565:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bc9330e00) 00010000:00010000:0.0:1788863908.419579:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863908.419584:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc10f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419590:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc10f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419637:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc116 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419643:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc116 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419648:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc116 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419653:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfeb64e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863908.419656:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc116 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419661:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc116 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419669:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8e8bc5119300) 00010000:00010000:0.0:1788863908.419671:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863908.419674:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc116 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419679:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc116 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419697:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc11d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419703:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc11d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419708:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc11d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.419722:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfeb64a00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863908.421426:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc11d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.421457:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc11d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.421478:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:0.0:1788863908.421482:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788863908.421489:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc11d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.421497:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc11d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863908.421656:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+22:14470:x1875759298896640:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 4301us (6227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.421667:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:3.0:1788863908.432517:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.432679:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298896896 00000100:00100000:0.0:1788863908.432695:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298896896 00000100:00100000:0.0:1788863908.432784:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:0.0:1788863908.432797:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+22:14470:x1875759298896896:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863908.432830:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863908.432914:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc124 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331371 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.433073:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc12b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.433119:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc12b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.433134:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc12b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863908.433151:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788863908.433309:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc12b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.433317:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc12b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.433326:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc12b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.433333:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfeb64e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863908.433339:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc12b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.433348:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc12b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.433361:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:0.0:1788863908.433364:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788863908.433370:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc12b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.433376:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64e00/0x744cd7666bbbc12b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.433445:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc124 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331371 expref: 24 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.433464:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8bc9330e00) 00010000:00010000:0.0:1788863908.433467:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788863908.433472:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc124 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331371 expref: 24 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.433483:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfeb64a00, rc 0) 00000100:00100000:0.0:1788863908.433572:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+23:14470:x1875759298896896:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 776us (1070us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788863908.433581:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:3.0:1788863908.439402:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.439708:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298897024 00000100:00100000:0.0:1788863908.439723:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298897024 00000100:00100000:0.0:1788863908.439801:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:0.0:1788863908.439814:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+23:14470:x1875759298897024:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788863908.439897:0:14318:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788863908.440287:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+23:14470:x1875759298897024:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 472us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.440296:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:2.0:1788863908.444286:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.444421:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298897280 00000100:00100000:0.0:1788863908.444437:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298897280 00000100:00100000:0.0:1788863908.444522:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:0.0:1788863908.444534:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+23:14470:x1875759298897280:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863908.444569:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863908.444616:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc139 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331378 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788863908.446423:0:14320:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:1.0:1788863908.446439:0:14320:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1788863908.446531:0:14320:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788863908.447512:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc140 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.447540:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc140 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.447557:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc140 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.447677:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64a00/0x744cd7666bbbc139 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331378 expref: 26 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.448839:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc140 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331378 expref: 25 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.448908:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:1.0:1788863908.448912:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788863908.448918:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b600, rc 0) 00000100:00100000:1.0:1788863908.450334:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+25:14470:x1875759298897280:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 5783us (6054us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788863908.450349:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:3.0:1788863908.458264:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863908.458484:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298897536 00000100:00100000:1.0:1788863908.458501:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298897536 00000100:00100000:1.0:1788863908.458595:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:1.0:1788863908.458610:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bc8514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+25:14470:x1875759298897536:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788863908.458732:0:14319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863908.458774:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc140 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331378 expref: 25 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.458801:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8bd20ddc00) 00010000:00010000:1.0:1788863908.458814:0:14319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863908.458847:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc14e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.458934:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc14e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.458948:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc14e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459315:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc155 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf1aae4a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459328:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc155 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1aae4a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459337:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc155 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1aae4a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459438:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc14e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459448:0:14319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc14e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459457:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc14e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459465:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863908.459473:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc14e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459483:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc14e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459493:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8bd20dd600) 00010000:00010000:1.0:1788863908.459497:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863908.459502:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc14e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459523:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a400/0x744cd7666bbbc14e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459545:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc155 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1aae4a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459552:0:14319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc155 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1aae4a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459558:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc155 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1aae4a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459564:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:1.0:1788863908.459568:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc155 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1aae4a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459575:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc155 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf1aae4a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459586:0:14319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf1aae4a5 (ffff8e8bd20dd900) 00010000:00010000:1.0:1788863908.459588:0:14319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863908.459591:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc155 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf1aae4a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.459597:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a000/0x744cd7666bbbc155 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf1aae4a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863908.460468:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bc8514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+24:14470:x1875759298897536:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1849us (2226us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788863908.460481:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:3.0:1788863908.463240:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863908.464055:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298897664 00000100:00100000:1.0:1788863908.464073:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298897664 00000100:00100000:1.0:1788863908.464160:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:1.0:1788863908.464192:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+24:14470:x1875759298897664:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788863908.464224:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863908.464266:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc15c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33137f expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.466600:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc163 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.466642:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc163 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.466663:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc163 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.467448:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc15c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33137f expref: 26 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.467474:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7b600/0x744cd7666bbbc163 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33137f expref: 25 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.467486:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8bd20dd800) 00010000:00010000:1.0:1788863908.467490:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788863908.467495:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7b600, rc 0) 00000100:00100000:1.0:1788863908.467605:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+25:14470:x1875759298897664:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3413us (4379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863908.467617:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:2.0:1788863908.474580:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863908.474818:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298897920 00000100:00100000:1.0:1788863908.474834:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298897920 00000100:00100000:2.0:1788863908.475222:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:2.0:1788863908.475237:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+25:14470:x1875759298897920:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788863908.475539:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc16a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.475562:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc16a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.475577:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc16a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788863908.476540:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788863908.476558:0:14319:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 537605704960ns, next at 538605701835ns, rc = 0 00000004:00010000:2.0:1788863908.477012:0:14319:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a63bee75 reply state 000000004ddadcb2 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc16a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863908.477043:0:14319:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788863908.477193:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+27:14470:x1875759298897920:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1955us (2625us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788863908.477202:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00010000:00010000:2.0:1788863908.480751:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc16a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.480775:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc16a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.480784:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc16a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.480791:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555400 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863908.480797:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc16a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.480807:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc16a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.480829:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8bd20dd800) 00010000:00010000:2.0:1788863908.480833:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788863908.480839:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc16a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.480846:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555400/0x744cd7666bbbc16a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863908.482599:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863908.485722:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298898048 00000100:00100000:1.0:1788863908.485781:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298898048 00000100:00100000:1.0:1788863908.485955:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:1.0:1788863908.485971:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+26:14470:x1875759298898048:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788863908.486011:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788863908.486042:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc171 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331386 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.486132:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc171 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331386 expref: 27 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.486152:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc171 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331386 expref: 27 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.486177:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8bd20dd800) 00010000:00010000:1.0:1788863908.486180:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788863908.486185:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bf4e7ba00, rc 0) 00000100:00100000:1.0:1788863908.486301:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+27:14470:x1875759298898048:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 333us (3721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863908.486309:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:3.0:1788863908.492166:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863908.492320:0:15006:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298898176 00000100:00100000:1.0:1788863908.492335:0:15006:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298898176 00000100:00100000:1.0:1788863908.492443:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1788863908.492456:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2351:x1875759298898176:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788863908.493037:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:2351:x1875759298898176:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 580us (884us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788863908.493048:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00080000:2.0:1788863908.493207:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863908.499582:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863908.499837:0:14322:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298898432 00000100:00100000:1.0:1788863908.499914:0:14322:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298898432 00000100:00100000:1.0:1788863908.500003:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1788863908.500016:0:14322:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+27:14470:x1875759298898432:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788863908.500458:0:14322:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+28:14470:x1875759298898432:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 442us (892us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788863908.500468:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1788863908.504297:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863908.504418:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298898688 00000100:00100000:2.0:1788863908.504436:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298898688 00000100:00100000:2.0:1788863908.504529:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:2.0:1788863908.504542:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+28:14470:x1875759298898688:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788863908.504739:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+28:14470:x1875759298898688:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 199us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863908.504747:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:3.0:1788863908.508023:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.508158:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298898816 00000100:00100000:0.0:1788863908.508173:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298898816 00000100:00100000:0.0:1788863908.508271:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:0.0:1788863908.508284:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+28:14470:x1875759298898816:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863908.508314:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863908.508343:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc178 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33138d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.508450:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc17f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.508470:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc17f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.508486:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc17f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788863908.508537:0:14318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788863908.508562:0:14318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc17f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.508610:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc178 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33138d expref: 30 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.508642:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc17f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33138d expref: 29 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.508673:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8bd20dd800) 00010000:00010000:0.0:1788863908.508676:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788863908.508682:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfeb65a00, rc 0) 00000100:00100000:0.0:1788863908.508775:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+29:14470:x1875759298898816:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 492us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.508783:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:0.0:1788863908.517064:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863908.517315:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298898944 00000100:00100000:2.0:1788863908.517336:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298898944 00000100:00100000:2.0:1788863908.517443:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1788863908.517459:0:15003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+6:2350:x1875759298898944:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788863908.517495:0:15003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788863908.517537:0:15003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010a599cd/0x744cd7666bbbc186 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd331394 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788863908.517589:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe5a3, blocks: 0x1 00010000:00010000:2.0:1788863908.517626:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1788863908.517632:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863908.517649:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010a599cd/0x744cd7666bbbc186 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331394 expref: 7 pid: 15003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.517680:0:15003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010a599cd/0x744cd7666bbbc186 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331394 expref: 7 pid: 15003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.517698:0:15003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bee554000, rc 0) 00000100:00100000:2.0:1788863908.517799:0:15003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:2350:x1875759298898944:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 344us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863908.518121:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1788863908.522740:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.526279:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298899200 00000100:00100000:0.0:1788863908.526308:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298899200 00000100:00100000:0.0:1788863908.526423:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1788863908.526436:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+29:14470:x1875759298899200:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788863908.526623:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+29:14470:x1875759298899200:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 188us (3901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.526794:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:3.0:1788863908.530448:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863908.530912:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298899328 00000100:00100000:1.0:1788863908.530930:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298899328 00000100:00100000:1.0:1788863908.531022:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:1.0:1788863908.531037:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+29:14470:x1875759298899328:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788863908.645309:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:3.0:1788863908.645345:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1788863908.645384:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788863908.645801:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+14:14470:x1875759298899328:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 114759us (115363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863908.647531:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:2.0:1788863908.648223:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788863908.648257:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324049280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788863908.648351:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863908.648439:0:15006:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324049280 00000100:00100000:2.0:1788863908.648451:0:15006:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324049280 00000100:00100000:2.0:1788863908.648527:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788863908.648538:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324049280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788863908.651292:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863908.651495:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298899456 00000100:00100000:3.0:1788863908.651510:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298899456 00000100:00100000:3.0:1788863908.651576:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1788863908.651591:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:2351:x1875759298899456:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788863908.652051:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:2351:x1875759298899456:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 463us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863908.652060:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00002000:00010000:2.0:1788863908.653416:0:15006:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788863908.653429:0:15006:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788863908.653432:0:15006:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788863908.653434:0:15006:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788863907 -> 1788863907 00002000:00010000:2.0:1788863908.653438:0:15006:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788863908.653541:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875759324049280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4998us (5183us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788863908.653553:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788863908.653596:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788863908.653787:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8bedc8ca80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788863908.653796:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324049280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788863908.655101:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.655559:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298899712 00000100:00100000:0.0:1788863908.655578:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298899712 00000100:00100000:0.0:1788863908.656068:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:0.0:1788863908.656084:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+14:14470:x1875759298899712:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788863908.656203:0:14318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863908.656270:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65a00/0x744cd7666bbbc17f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33138d expref: 14 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.656317:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8bd20dd800) 00010000:00010000:0.0:1788863908.656325:0:14318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788863908.656399:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc18d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.656419:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc18d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.656431:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc18d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788863908.657260:0:14318:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d349b91 reply state 00000000284795ba transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc18d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863908.657279:0:14318:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788863908.657457:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+15:14470:x1875759298899712:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1373us (2369us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788863908.657467:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00010000:00010000:2.0:1788863908.661569:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc18d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.661610:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc18d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.661620:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc18d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.661820:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfeb65800 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863908.661996:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc18d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.662012:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc18d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.662044:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8bd20dd800) 00010000:00010000:2.0:1788863908.662048:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863908.662056:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc18d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.662066:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb65800/0x744cd7666bbbc18d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863908.663039:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.663298:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298899840 00000100:00100000:0.0:1788863908.663316:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298899840 00000100:00100000:0.0:1788863908.663400:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:0.0:1788863908.663413:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:14470:x1875759298899840:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788863908.663440:0:15005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788863908.663465:0:15005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc81fde49fd33139b expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.663509:0:15005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010a599cd/0x744cd7666bbbc186 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331394 expref: 8 pid: 15003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.663519:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863908.663524:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863908.663540:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33139b expref: 8 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.663587:0:15005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010a599cd/0x744cd7666bbbc186 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331394 expref: 8 pid: 15003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.663606:0:15005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010a599cd/0x744cd7666bbbc186 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331394 expref: 8 pid: 15003 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863908.663624:0:15005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15005:1875759324049408:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788863908.663847:0:15005:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc133acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863908.665815:0:15005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15005:1875759324049408:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788863908.666021:0:15005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33139b expref: 8 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.666056:0:15005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8bfeb65a00, rc 0) 00000100:00100000:1.0:1788863908.666662:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+8:14470:x1875759298899840:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3245us (3631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863908.666676:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1788863908.668486:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.669524:0:14303:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298899968 00000100:00100000:0.0:1788863908.669546:0:14303:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298899968 00010000:00010000:0.0:1788863908.669619:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010a599cd/0x744cd7666bbbc186 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331394 expref: 8 pid: 15003 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863908.669734:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1788863908.669747:0:14303:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+8:2351:x1875759298899968:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788863908.669776:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863908.669816:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010a599cd/0x744cd7666bbbc186 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331394 expref: 8 pid: 15003 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.669892:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010a599cd/0x744cd7666bbbc186 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331394 expref: 8 pid: 15003 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.669927:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010a599cd/0x744cd7666bbbc186 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331394 expref: 8 pid: 15003 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.669950:0:14303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863908.669956:0:14303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788863908.669964:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33139b expref: 7 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.669976:0:14303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33139b expref: 7 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.670033:0:14303:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33139b expref: 7 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863908.670050:0:14303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14303:1875759324049536:192.168.204.51@tcp:105: 00000100:00100000:0.0:1788863908.670168:0:14303:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc133acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788863908.673982:0:14303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14303:1875759324049536:192.168.204.51@tcp:105: 00010000:00010000:0.0:1788863908.674028:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863908.674105:0:14303:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:2351:x1875759298899968:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 4359us (5631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.674139:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1788863908.677150:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863908.677593:0:15006:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298900096 00000100:00100000:2.0:1788863908.677610:0:15006:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298900096 00000100:00100000:2.0:1788863908.677705:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1788863908.677717:0:15006:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:2350:x1875759298900096:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788863908.678471:0:15006:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788863908.678479:0:15006:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788863907 00002000:00010000:2.0:1788863908.678483:0:15006:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788863906 00002000:00010000:2.0:1788863908.678486:0:15006:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788863907 -> 1788863907 00002000:00010000:2.0:1788863908.678489:0:15006:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788863908.678578:0:15006:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+8:2350:x1875759298900096:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 861us (1446us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788863908.678601:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:1.0:1788863908.686315:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863908.686554:0:15003:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298900224 00000100:00100000:2.0:1788863908.686570:0:15003:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298900224 00000100:00100000:3.0:1788863908.687332:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1788863908.687349:0:15003:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+8:2353:x1875759298900224:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788863908.687428:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.687460:0:15003:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33139b expref: 8 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.687471:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863908.687477:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788863908.687482:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.687562:0:15003:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33139b expref: 8 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.687581:0:15003:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33139b expref: 8 pid: 15005 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863908.687600:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15003:1875759324049664:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788863908.688756:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc7345540 going to sleep for 11 seconds 00000100:00100000:1.0:1788863908.707936:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863908.708089:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15003:1875759324049664:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788863908.708131:0:15003:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863908.710434:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298900352 00000100:00100000:2.0:1788863908.710460:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298900352 00010000:00010000:2.0:1788863908.710562:0:14305:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33139b expref: 9 pid: 15005 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863908.710629:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1788863908.710642:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:2350:x1875759298900352:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863908.710668:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863908.710708:0:14305:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33139b expref: 9 pid: 15005 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.710727:0:14305:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33139b expref: 9 pid: 15005 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.710773:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b58bef37/0x744cd7666bbbc194 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33139b expref: 9 pid: 15005 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.711084:0:14305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863908.711089:0:14305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788863908.711099:0:14305:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.711112:0:14305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.711159:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863908.711260:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+8:2350:x1875759298900352:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 620us (3342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863908.711288:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00010000:00010000:3.0:1788863908.713316:0:15003:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.713352:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.713403:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.713413:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.713448:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.713455:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863908.713461:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.713471:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.713500:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.713520:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc19b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863908.713978:0:15003:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:2353:x1875759298900224:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 26624us (28390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863908.713991:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1788863908.724187:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863908.724443:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298900608 00000100:00100000:2.0:1788863908.724464:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298900608 00000100:00100000:2.0:1788863908.724569:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:2.0:1788863908.724987:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+14:14470:x1875759298900608:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788863908.725177:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.725201:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.725217:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.726332:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.726363:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc171 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331386 expref: 15 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.726374:0:14320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.726438:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc171 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331386 expref: 15 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.726462:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc171 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331386 expref: 15 pid: 14320 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863908.726504:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14320:1875759324049792:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788863908.726740:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc33c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863908.730731:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14320:1875759324049792:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788863908.730774:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863908.731464:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863908.731556:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298900736 00000100:00100000:2.0:1788863908.731567:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298900736 00010000:00010000:2.0:1788863908.731932:0:14304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc171 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331386 expref: 16 pid: 14320 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863908.731979:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:2.0:1788863908.731992:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+16:2350:x1875759298900736:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788863908.732015:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863908.732024:0:14304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc171 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331386 expref: 16 pid: 14320 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.732041:0:14304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc171 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331386 expref: 16 pid: 14320 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.732075:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7ba00/0x744cd7666bbbc171 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xc81fde49fd331386 expref: 16 pid: 14320 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.732097:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8bd20dd800) 00010000:00010000:2.0:1788863908.732103:0:14304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.732132:0:14304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.732141:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.732174:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788863908.732385:0:14320:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.732406:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788863908.732752:0:14320:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788863908.733104:0:14320:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788863908.733156:0:14320:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788863908.733282:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff136680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14320:1875759324049920:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788863908.733515:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+18:2350:x1875759298900736:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1519us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863908.733528:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1788863908.734146:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863908.734214:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2bee180 going to sleep for 11 seconds 00000100:00100000:2.0:1788863908.734306:0:14323:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324049920 00000100:00100000:2.0:1788863908.734321:0:14323:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324049920 00000100:00100000:2.0:1788863908.734376:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788863908.734388:0:14323:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14320:x1875759324049920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788863908.734538:0:14323:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14320:x1875759324049920:12345-0@lo:1000:mdt00_002.0 Request processed in 152us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863908.734546:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788863908.735411:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff136680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14320:1875759324049920:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788863908.736903:0:14320:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788863908.737052:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14320:1875759324050048:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788863908.737170:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863908.737210:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2bee9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788863908.737365:0:14323:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324050048 00000100:00100000:2.0:1788863908.737379:0:14323:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324050048 00000100:00100000:2.0:1788863908.737453:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788863908.737466:0:14323:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14320:x1875759324050048:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788863908.738062:0:14323:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14320:x1875759324050048:12345-0@lo:1000:mdt00_002.0 Request processed in 595us (888us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788863908.738075:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788863908.738220:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14320:1875759324050048:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788863908.738294:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738309:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738319:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738326:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863908.738334:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738343:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738371:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8bd20dd800) 00010000:00010000:0.0:1788863908.738375:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863908.738383:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738389:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee554000/0x744cd7666bbbc1a9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738449:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64000/0x744cd7666bbbc101 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738455:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64000/0x744cd7666bbbc101 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738462:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64000/0x744cd7666bbbc101 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738468:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bfeb64000 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:0.0:1788863908.738471:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64000/0x744cd7666bbbc101 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738476:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64000/0x744cd7666bbbc101 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738486:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:0.0:1788863908.738489:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788863908.738499:0:14320:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc108 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33136a expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738517:0:14320:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc108 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33136a expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738527:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc108 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33136a expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863908.738593:0:14320:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bf4e7a800/0x744cd7666bbbc108 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xc81fde49fd33136a expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863908.738622:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bcabde680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14320:1875759324050176:192.168.204.51@tcp:105: 00000100:00100000:0.0:1788863908.739025:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e8bc2beea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788863908.743560:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863908.743836:0:14322:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298900864 00000100:00100000:1.0:1788863908.743847:0:14322:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298900864 00000100:00100000:1.0:1788863908.743995:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1788863908.744007:0:14322:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8beda53050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+19:14469:x1875759298900864:12345-192.168.204.51@tcp:49:dd.0 00000100:00100000:2.0:1788863908.744009:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bcabde680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14320:1875759324050176:192.168.204.51@tcp:105: 00010000:00010000:2.0:1788863908.744054:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64000/0x744cd7666bbbc101 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744096:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bfeb64000/0x744cd7666bbbc101 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744153:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc1b0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744173:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc1b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744190:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc1b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744201:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc1b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744208:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc1b0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744215:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc1b0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744222:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555e00 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863908.744226:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc1b0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744235:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc1b0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744264:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:2.0:1788863908.744267:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788863908.744271:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc1b0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744284:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555e00/0x744cd7666bbbc1b0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744297:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744303:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744308:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744313:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555200 already unused, calling callback (ffffffffc1fd44f0) 00010000:00010000:2.0:1788863908.744315:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744321:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1a2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744628:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8bd20dd100) 00010000:00010000:2.0:1788863908.744633:0:14320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788863908.744645:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1a2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.744652:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14320 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863908.744844:0:14322:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8beda53050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+19:14469:x1875759298900864:12345-192.168.204.51@tcp:49:dd.0 Request processed in 835us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863908.744874:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1788863908.745256:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+18:14470:x1875759298900608:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 20675us (21095us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788863908.745267:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000020:00080000:2.0:1788863908.745286:0:14320:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788863908.745488:0:14349:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788863908.745493:0:14349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788863908.745527:0:14349:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788863908.745534:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788863908.750548:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863908.750659:0:14321:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298901120 00000100:00100000:3.0:1788863908.750678:0:14321:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298901120 00000100:00100000:3.0:1788863908.751290:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788863908.751309:0:14321:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+18:14470:x1875759298901120:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788863908.754943:0:14321:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788863908.755097:0:14321:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788863908.755201:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.755249:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.755266:0:14321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.755276:0:14321:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1b7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.755284:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1b7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.755291:0:14321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.755321:0:14321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788863908.755511:0:14321:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+20:14470:x1875759298901120:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 4197us (4971us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788863908.755528:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000020:00080000:2.0:1788863908.755538:0:14321:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788863908.755901:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788863908.755928:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.755937:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee555200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863908.755943:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.755955:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.755974:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8bd20dd800) 00010000:00010000:3.0:1788863908.755978:0:14307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788863908.755986:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1b7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.755992:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8bee555200/0x744cd7666bbbc1b7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14321 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863908.756011:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863908.756014:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863908.756016:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863908.867634:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788863908.867703:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863908.868287:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298901248 00000100:00100000:1.0:1788863908.868304:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298901248 00000100:00100000:1.0:1788863908.868415:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298901376 00000100:00100000:1.0:1788863908.868420:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298901376 00000100:00100000:1.0:1788863908.868447:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1788863908.868462:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+8:2351:x1875759298901248:12345-192.168.204.51@tcp:4:dd.0 00002000:00010000:1.0:1788863908.868577:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9fe5a3, atime: 0x6a9fe5a2, ctime: 0x6a9fe5a3, blocks: 0x1 00010000:00010000:1.0:1788863908.868594:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.868620:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1788863908.868627:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863908.868635:0:15010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.868657:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863908.872773:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788863908.873061:0:15009:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788863908.873073:0:15009:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788863908.878153:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298901504 00000100:00100000:1.0:1788863908.878174:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298901504 00000100:00100000:2.0:1788863908.880840:0:16553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1788863908.880908:0:16553:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bcabde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+10:2353:x1875759298901376:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:2.0:1788863908.880969:0:16553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2e5825/0x744cd7666bbbc1c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.881006:0:16553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788863908.881010:0:16553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788863908.881019:0:16553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e2e5825/0x744cd7666bbbc1c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863908.881043:0:16553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e2e5825/0x744cd7666bbbc1c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863909.023389:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788863909.093452:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1788863909.093490:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1788863909.106936:0:15010:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1788863909.106947:0:15010:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4099 00010000:00010000:1.0:1788863909.106964:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.106977:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.106985:0:15010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.106992:0:15010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ba00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863909.106997:0:15010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.107026:0:15010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.107049:0:15010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.107057:0:15010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863909.107222:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+10:2351:x1875759298901248:12345-192.168.204.51@tcp:4:dd.0 Request processed in 238756us (239603us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788863909.107242:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1788863909.107294:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1788863909.107309:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:2350:x1875759298901504:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:1.0:1788863909.107348:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.107364:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863909.107369:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863909.107375:0:15010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.107389:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788863909.182827:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:2.0:1788863909.183734:0:16553:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1788863909.183763:0:16553:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4099 -> 4103 00010000:00010000:2.0:1788863909.183782:0:16553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2e5825/0x744cd7666bbbc1c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863909.183796:0:16553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e2e5825/0x744cd7666bbbc1c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863909.183806:0:16553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e2e5825/0x744cd7666bbbc1c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863909.183815:0:16553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bee554200 already unused, calling callback (ffffffffc1577930) 00010000:00010000:2.0:1788863909.183821:0:16553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2e5825/0x744cd7666bbbc1c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863909.183833:0:16553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2e5825/0x744cd7666bbbc1c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863909.183895:0:16553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e2e5825/0x744cd7666bbbc1c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863909.183903:0:16553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e2e5825/0x744cd7666bbbc1c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788863909.184012:0:16553:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bcabde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:2353:x1875759298901376:12345-192.168.204.51@tcp:4:dd.0 Request processed in 303116us (316304us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788863909.184023:0:16553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000001:00080000:3.0:1788863909.378238:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1788863909.392481:0:15010:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1788863909.392503:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863909.392517:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863909.392526:0:15010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863909.392533:0:15010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863909.392539:0:15010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863909.392549:0:15010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863909.392607:0:15010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863909.392624:0:15010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863909.392740:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2350:x1875759298901504:12345-192.168.204.51@tcp:4:dd.0 Request processed in 285432us (519977us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788863909.392755:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:0.0:1788863909.408339:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863909.408495:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298901632 00000100:00100000:1.0:1788863909.408506:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298901632 00000100:00100000:1.0:1788863909.408590:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:1.0:1788863909.408601:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2352:x1875759298901632:12345-192.168.204.51@tcp:4:dd.0 00002000:00010000:1.0:1788863909.408663:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9fe5a3, atime: 0x6a9fe5a2, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1788863909.408673:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.408690:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1788863909.408694:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863909.408701:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.408718:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863909.414564:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863909.414631:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863909.432925:0:16553:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298901760 00000100:00100000:3.0:1788863909.432947:0:16553:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298901760 00000100:00100000:1.0:1788863909.433201:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788863909.433251:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863909.435804:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298901888 00000100:00100000:3.0:1788863909.435820:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298901888 00000100:00100000:3.0:1788863909.435898:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298902016 00000100:00100000:3.0:1788863909.435902:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298902016 00000100:00100000:3.0:1788863909.435917:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298902144 00000100:00100000:3.0:1788863909.435919:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298902144 00000100:00100000:3.0:1788863909.435940:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1788863909.435949:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:2353:x1875759298901888:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:3.0:1788863909.436000:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc1da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863909.436021:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863909.436025:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788863909.436031:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc1da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863909.436046:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc1da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788863909.619249:0:15011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:1.0:1788863909.619259:0:15011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1788863909.619274:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc1da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.619311:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc1da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.619319:0:15011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc1da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.619326:0:15011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bffc16800 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863909.619330:0:15011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc1da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.619339:0:15011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc1da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.619361:0:15011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc1da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.619369:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac3d7295/0x744cd7666bbbc1da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863909.619487:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+14:2353:x1875759298901888:12345-192.168.204.51@tcp:4:dd.0 Request processed in 183534us (204850us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788863909.619497:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1788863909.619530:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1788863909.619541:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+13:2353:x1875759298902016:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:1.0:1788863909.619571:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.619591:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863909.619595:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863909.619601:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.620090:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863909.620518:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:3.0:1788863909.780172:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:0.0:1788863909.781123:0:15009:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1788863909.781131:0:15009:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788863907 -> 1788863908 00002000:00010000:0.0:1788863909.781135:0:15009:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788863908 00002000:00010000:0.0:1788863909.781137:0:15009:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1788863909.781162:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863909.781182:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863909.781204:0:15009:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863909.781213:0:15009:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863909.781228:0:15009:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863909.781259:0:15009:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863909.781290:0:15009:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863909.781299:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863909.781547:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+11:2352:x1875759298901632:12345-192.168.204.51@tcp:4:dd.0 Request processed in 372940us (373211us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788863909.781558:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:1.0:1788863909.781711:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1788863909.781725:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bca962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+10:2353:x1875759298902144:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:1.0:1788863909.781761:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.781775:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863909.781780:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863909.781786:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.781799:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788863909.881069:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:1.0:1788863909.885095:0:15011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1788863909.885119:0:15011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:1.0:1788863909.885135:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.885149:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.885157:0:15011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.885164:0:15011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a000 already unused, calling callback (ffffffffc1577930) 00010000:00010000:1.0:1788863909.885169:0:15011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.885176:0:15011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.885223:0:15011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.885231:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000df3e69d/0x744cd7666bbbc1e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863909.885344:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+10:2353:x1875759298902016:12345-192.168.204.51@tcp:4:dd.0 Request processed in 265801us (452144us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788863909.885355:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1788863909.885394:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1788863909.885411:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:2352:x1875759298901760:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:1.0:1788863909.885444:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.885459:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788863909.885462:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788863909.885468:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863909.885479:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863909.978438:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324050688:0@lo:400:kworker.0 00000100:00100000:0.0:1788863909.978507:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863909.978574:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863909.978581:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324050560:0@lo:400:kworker.0 00000100:00100000:0.0:1788863909.978624:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863909.978665:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324050688 00000100:00100000:0.0:1788863909.978674:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324050688 00000100:00100000:0.0:1788863909.978720:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788863909.978728:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324050688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863909.978778:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875759324050688:12345-0@lo:400:kworker.0 Request processed in 50us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863909.978784:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788863909.978806:0:15908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324050560 00000100:00100000:0.0:1788863909.978809:0:15908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324050560 00000100:00100000:0.0:1788863909.978847:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863909.978872:0:15908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324050560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863909.978936:0:15908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324050560:12345-0@lo:400:kworker.0 Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863909.978943:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863909.978982:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788863909.978989:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8bedc8ca80, transno 8589934595 00000004:00080000:0.0:1788863909.978999:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788863909.979064:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324050560:0@lo:400:kworker.0 00000100:00100000:0.0:1788863909.979104:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875759324050688:0@lo:400:kworker.0 00000100:00100000:1.0:1788863909.979452:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff07d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324050432:0@lo:400:kworker.0 00000100:00100000:1.0:1788863909.979491:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863909.979522:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff07f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324050944:0@lo:400:kworker.0 00000100:00100000:1.0:1788863909.979544:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863909.979565:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788863909.979572:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bf4c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324050304:0@lo:400:kworker.0 00000100:00100000:1.0:1788863909.979612:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863909.979637:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff07ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759324050816:0@lo:400:kworker.0 00000100:00100000:1.0:1788863909.979658:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863909.979686:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324050944 00000100:00100000:1.0:1788863909.979691:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324050944 00000100:00100000:1.0:1788863909.979727:0:14318:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324050816 00000100:00100000:1.0:1788863909.979730:0:14318:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324050816 00000100:00100000:1.0:1788863909.979745:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863909.979751:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324050944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863909.979799:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875759324050944:12345-0@lo:400:kworker.0 Request processed in 47us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863909.979805:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788863909.979821:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788863909.979828:0:14318:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759324050816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863909.979873:0:14318:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875759324050816:12345-0@lo:400:kworker.0 Request processed in 45us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863909.979879:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788863909.979907:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff07ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875759324050816:0@lo:400:kworker.0 00000100:00100000:1.0:1788863909.979916:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff07f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875759324050944:0@lo:400:kworker.0 00000100:00100000:0.0:1788863909.980446:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324050432 00000100:00100000:0.0:1788863909.980455:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324050432 00000100:00100000:0.0:1788863909.980540:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788863909.980549:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324050432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863909.980615:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875759324050432:12345-0@lo:400:kworker.0 Request processed in 66us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863909.980621:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788863909.980737:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff07d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875759324050432:0@lo:400:kworker.0 00000100:00100000:0.0:1788863909.987365:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324050304 00000100:00100000:0.0:1788863909.987381:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324050304 00000100:00100000:0.0:1788863909.987484:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788863909.987496:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:3307:x1875759324050304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863909.987775:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98ce9f4a-6069-439b-828d-fac2605e9de4+19:3307:x1875759324050304:12345-0@lo:400:kworker.0 Request processed in 108us (8003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863909.987784:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788863909.987902:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bf4c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98ce9f4a-6069-439b-828d-fac2605e9de4:3307:1875759324050304:0@lo:400:kworker.0 00000100:00080000:2.0:1788863909.988038:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863909.988045:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863909.988113:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863909.988127:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324051072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863909.988168:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863909.988228:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324051072 00000100:00100000:3.0:1788863909.988235:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324051072 00000100:00100000:3.0:1788863909.988288:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788863909.988298:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bedc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324051072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863909.988316:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 66387968 pending 3407872 free 3853516800 avail 3851419648 00000100:00100000:3.0:1788863909.988369:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bedc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875759324051072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863909.988375:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863909.989028:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bedc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875759324051072:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788863910.003309:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1788863910.006648:0:15009:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788863910.006672:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863910.006700:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863910.006710:0:15009:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863910.006718:0:15009:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7ba00 already unused, calling callback (ffffffffc1577930) 00010000:00010000:3.0:1788863910.006723:0:15009:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863910.006732:0:15009:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863910.006754:0:15009:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863910.006763:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a8471b/0x744cd7666bbbc1e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863910.006919:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bca962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+9:2353:x1875759298902144:12345-192.168.204.51@tcp:4:dd.0 Request processed in 225194us (573662us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788863910.006930:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00010000:00010000:0.0:1788863910.038981:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863910.039972:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863910.040003:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863910.040014:0:15011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863910.040021:0:15011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8bf4e7a400 already unused, calling callback (ffffffffc1577930) 00010000:00010000:0.0:1788863910.040026:0:15011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863910.040035:0:15011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863910.040056:0:15011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863910.040064:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010406899/0x744cd7666bbbc1ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788863910.040166:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+7:2352:x1875759298901760:12345-192.168.204.51@tcp:4:dd.0 Request processed in 154753us (625607us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788863910.040178:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000001:00080000:1.0:1788863910.040375:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00000100:00100000:3.0:1788863910.206527:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863910.206630:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863910.206663:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863910.206722:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863910.206745:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863910.206765:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788863910.206791:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298902528 00000100:00100000:3.0:1788863910.206800:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298902528 00000100:00100000:3.0:1788863910.206871:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298902784 00000100:00100000:3.0:1788863910.206875:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298902784 00000100:00100000:3.0:1788863910.206891:0:15005:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298902912 00000100:00100000:3.0:1788863910.206894:0:15005:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298902912 00000100:00100000:3.0:1788863910.206913:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:3.0:1788863910.206923:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2353:x1875759298902528:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863910.207012:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+5:2353:x1875759298902528:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 90us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863910.207021:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:3.0:1788863910.207040:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788863910.207048:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f576e463-13c4-424a-a092-65e3da1791c5+5:2353:x1875759298902784:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863910.207089:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f576e463-13c4-424a-a092-65e3da1791c5+5:2353:x1875759298902784:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 41us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863910.207095:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788863910.207106:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:3.0:1788863910.207112:0:15005:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f576e463-13c4-424a-a092-65e3da1791c5+5:2353:x1875759298902912:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863910.207135:0:15005:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f576e463-13c4-424a-a092-65e3da1791c5+5:2353:x1875759298902912:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863910.207140:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:3.0:1788863910.207176:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298902400 00000100:00100000:3.0:1788863910.207180:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298902400 00000100:00100000:3.0:1788863910.207229:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298902656 00000100:00100000:3.0:1788863910.207233:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298902656 00000100:00100000:3.0:1788863910.207249:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1788863910.207255:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+20:2353:x1875759298902400:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863910.207303:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2d51fb3-4c9f-4aa1-ae4f-64214f247867+20:2353:x1875759298902400:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 48us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863910.207310:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1788863910.207321:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:3.0:1788863910.207327:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bff0b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+6:2353:x1875759298902656:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788863910.207352:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bff0b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f576e463-13c4-424a-a092-65e3da1791c5+6:2353:x1875759298902656:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863910.207358:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00080000:2.0:1788863910.208900:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788863910.208910:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863910.208912:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863910.215507:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759298902272 00000100:00100000:1.0:1788863910.215537:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759298902272 00000100:00100000:1.0:1788863910.215741:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:1.0:1788863910.215756:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bf4e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+13:2353:x1875759298902272:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788863910.215885:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bf4e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757561f2-9678-4319-9860-6d7710ce5d8a+13:2353:x1875759298902272:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 133us (9368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863910.215895:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:1.0:1788863910.999811:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863910.999834:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e8bff0b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324051200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863910.999920:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863911.000256:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759324051200 00000100:00100000:3.0:1788863911.000267:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759324051200 00000100:00100000:3.0:1788863911.000339:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788863911.000349:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8bee551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324051200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788863911.000394:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788863911.000442:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8bee551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875759324051200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863911.000448:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788863911.000697:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863911.000916:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e8bff0b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875759324051200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788863911.063117:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863911.844825:0:16592:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788863912.090419:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863913.110340:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788863913.634366:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000020:00080000:1.0:1788863913.634385:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8bc2bee0c0 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:1.0:1788863913.634438:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bef954f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bc133acc0 00000020:00080000:1.0:1788863913.634442:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e8bef954700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8bff747000 00000001:00080000:1.0:1788863913.634472:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1788863913.634505:0:14357:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:3.0:1788863913.634769:0:14357:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 Debug log: 29842 lines, 29842 kept, 0 dropped, 0 bad.